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ABSTRACT 

A unified theory of planning and debugging is 
explored Jjy designing a problea solving prograa called PATH, PATH" 
uses an augaented transition network (ATM) to represent a broad range 
of planning technigues, including identification, decoaposition; and 
reforaulation. (The ATI is a siaple yet powerful foraalisa which has. 
been effectively utilized in coaputational linguistics.) PATH'S plans 
aay aanifest "rational bugs," which result fr'oa heuristically ' 
justifiable but incorrect arc transitions in the^planning AIH* This 
aspect of the theory is developed by desxgning^afedapleaentary 
debugging aoduie called DIPB, which would diagnose and repair the 
errors in PATH'S annotated plans. The investigation is incomplete as. 
PATH . has not yet been iapleaented, but sufficient detail is presented 
Ax> provide a theoretical fraaevork' for recotfceptualizing sussnan^s ' 
HACKBB research* Since a detailed study of planning and debugging 
technigues is a prereguisite ;cor 'coaplete fulfUllaent of Dijkstra's 
objectives of prograa reliability, readability, portability, and so 
on, the theory is called "Structured^ Planning and Debugging" to. 
eaphasizd its potential role in this enterprise. Fifty-seven * 
references are listed. (Author ALS) »• 
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\ A unified theory of planning and debugging is explored by designing a problem 

solving program called PATN. PATN uses an augmented transition network (ATN) to 
* represent a broad range of planning techniques, including identification, decomposition, 
and refogmilatio^ (The ATN [Woods 1970] Is.a simple yet powerful formalism jtfhlch 
' has been effectively utilized in computational linguistics.) / 

PATN's plins may, manifest "rational bugs," which result from h<u£*4ticatly 
t Justifiable but incorrect arc transitions" in the planning ATN. This aspect of. the theory 
Is developed by designing a complementary debugging module called DAPR, phich 
would diagnose and repair the errors in ~P ATN *s .annotated plans. 

The investigation Is incomplete: PATN has not yet been implemented. But 
sufficient detail Is presented to provide a theoretical framework for reconceptualizing 
Sussman\ll973] HACKER research. 
, . Since a detailed study of planning and debugging techniques is a prerequisite for 

complete fulfillment of Dijkstra's objectives of program reliability, readability, 
portability, and so on, the theory is called, "Structured Planning and Debugging* to 
* emphasize its potential role in this enterprise. 



. This report is a revised version of AI Working Paper 125 (Logo Working Paper 55). It 
^ describes research dope at the Artificial Intelligence Laboratory of the Massachusetts Institute of 
^ Technology. It was supported' in part by the National Science Foundation under grant C40708X, 
%y * in part by the, Advanced Research Projects Agency of the Department of Defense under Qf fke of 
v* - Naval Research contract N006H-75-C-0643, and in part by the Division for Study and Research in 
0 s * , Education, Massachusetts Institute of Technology. 
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Structured Planning and Debugging 3 Goldstein & Miller 

' . {• 1. Introduction 

' Though It it difficult to. prescribe any Thing in those Sorts of Cases, and every 
Person's own Genius ought.'to be his Guide in thise Operations; yet I will 
endeavor' to show the Way to Learners. 

Newton, Universal Arithmfctick (translated by Ralphson, 1769, p. 198)„, 

from {Poly a 1965, p. 89 \>± . . \ 

The structured programming movement [Dahlet al. 1972] has focused, the concern of 
computer scientisu on the process of jreating prdferams. Work In artificial intelligence (AI) has 
developed a complementary theory of debugging [Sussman 1973; Goldstein 19741 But, except for 
SacerdotT^ [19753 work on procedural nets, a comprehensive Approach has not yet Wen attempted". 
This is a preliminary report on a theory called Structured Manning and Debugging 1 which we 
believe to be a step towards an integrated theory of design. V r ' m 

Our task has two aspects. First, we hope to understand ceruin intricacies of planning and 

• • ; - 
debugging, such as are encountered in the design of program^ which must, take into account 

interactions in achieving dependent subgoals, *Thf second^aspect of our task is to seek a 

1 • r 

representational framework In which to elucidate these subtleties, and in vhich to structure a wide 

variety o( planning techniques. Our methodology is to begin 'with simple but clear formalisms, 

. 1 ' J 

studying their virtues and limitations. Our research plan Is then to investigate a series of 

progressively more powerful and elaborate representations, after we have reached a solid 

understanding as to where the extra power is needed, and why? 

In earlier work, we have studied one particularly simple representation for planning 

knowledge, context free grammars (e^ [Miller k Goldstein I97£b]) In ttys ess#y we pursue the 

investigation by exploring the u$e'of a more elaborate formalism. We utilize an augmented 

transition network (ATN) [Woods 1970]* to represent an hierarchical taxonomy of planning 

methods. We are exploring ATNs as a representation for planning concepts because the/directly 

q£n*ralize context free grammars, and because work iri computational linguistics has shown them 
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Structured Planning and debugging 4 Goldstein * Milter 

' ' ' ' ' ' ' /' , . .\ v ■ 

' to be both perspicuous and rich inexpressive power. 3 " ' ' ^ 

An A^TN is Mflnttt^tate transition frapk with labelled states and arcs, augmented by 
^recursion and a finite number, oj registers. Associated with each'arc may be .conditions on 
following the arc, and actions to be executed If the arc Is followed. Typically the conditions are 
restricted to Boolean predicates /over the contents of the registers. The actions are* restricted to 
structure building and oiodifylng the contents of the register ' 

( w/aifcly the ATN formalism to panning by representing possible planning decisions a*, 
transitions between nodes of /the network. The sema^tj context, including the problem description. 
Is defined using the ATNj, registers. Pragmatic knowledge, specifying whfeh planning strategies 
to apply In wh,lch situations, is modeled by arc transition constraints.. The ATN constructed in this 
fashion defines a problem solving program railed PATN (Planning ATN). 

CAVEAT: to simplify the discussion we speitk- of PATN as If it were a 
y working program However, at this point In time. PATN is only a design. 
- ThlJ d «*gn I* sufficiently precise to be hand-simulated on simple problems, but 

thorough testing must await implementation. 
The possibility^ rational errors makes debugging an important part of ^ny problem solving 
theory. Rational errors are defined as mistakes in planning that'arlse from the use of reasonable 
heuristics Ttys aspect of oJr theory is developed by designing DAPR (an acronym for Debugger , 
of Annotated PRogram), a debugging module for use wlth'PATN. In DAPR terms? diagnosis is 
the isolation of incorrect or incomplete transitions made between ATN states during the planning 
process: Repair consists of re-planning, guided by advice from the diagnosis. A description of 
basic bug types in terms of specific errors in the planning process is undertaken. DAPR would 
diagnose and repair annotated programs, in that a Record of PATN's planning decisions (the 
derivation trie) is expected to be associated with the code. * 

Throughout (he paper, we employ examples from two benchmark Ai domains: the blocks 
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worM,and the Logo turtle world fPapert 1971a, 1971b, 19731 Btoejs world problem solvers Include 
SHIJDLU [Wlnograd 19721. BUILD rFahlman 1974], HACKER [Simman 1973] and NOAH 
t^acenlotl 19751 Hence, applying PATN to tlje blocks WorloVprovldes a common set 'of problems 
for comparison. The virtues of the Logo graphics world are (a) graphics Is an environment In 
Which multiple problem descriptions are possibly ranging ffom Euclidean geometry # Cartesian 
geometry; (b) the possible programs range over a wide spectrum of complexity; and (c) extensive 
documentation exist* on human performance in this area [G, Goldstein 1973; Okumura 1973} 

'Section two presents a uxonoimy of planning techniques, and usei this taxonomy to construct 
thte planning ATN. This defines a basic problem solver which, due to its reliance on exhaustive 
backtracking search in traversing the ATN, would be Inefficient The third section addresses thfa 
drawback, discusSing.subtlet.es in planning when viewed as a search process Since certain 
hetiristically Justifiable phnhinfe choices, can nonetheless lead to bugs," seltion four develops a 



complementary theory of debugging: This allows for reconceptualizin'g Sussman's [1973] HACKER 

( • ' ? 

In sectipn five. .The concluding section cpnsiders limitations, extensions, and applications of the 

■(■ . f'* 

Structured Planning and Debugging approach/ 
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For a fortnight I had bttrt attempting to provt that thtre could not bo any 
function analogous to what I have since callad Fuchsian function*. I was at that 
timer vary Ignorant. Evary day I sal down at my table and spent^an hour or two 
trying a great number of combinations, and I arrived at no result t)ne night 1 
took some black coffee, contrary to my custom, and was unable to sleep. A host < 
of ideas kept surging in my bead; I could almost feel them jostling one another, 
until two of them coalesced, so to speafC to form a stable combination. When 
morning came, I had established fhe existence of one class of Fuchsian functions- 

Poincare, H, "Mathematical Discovery" in [Rapport 1963, p. 132] * 

• In this passage, Poincare seems to suggest that human problem solving relies heavily upon 
laborious consideration of numerous possibilities. Is Poincare coirect, or is there a welt organized 
collection of planning concepts to guide the problem solver? Polya'* many insightful analyses 0957. 
1962. 1965. 1967] support the assertion that planning knowledge is highly structured. This' section' 
pursues a view closer to Polya's, by classifying plans, and by developing that classification into a 
procedural theory of design. 

Figure I shows an hierarchical taxonomy of common planning techniques. 4 We shall 
illustrate how an ATN can be used to represent this planning knowledge procedurally, by 
scrutinizing solution by (a) Identification with previous solutions and (b) decomposition Into • 
conjunctive subgoals. The taxonomy shown in the figure is more extensive than this. In order to 
indicate the context in which our. discussion takes place. Repetition and reformulation are 
considered, briefly, near the end of this section. * 

1n <he taxonomy, planning begins with a choice between three methods - Identification, , 
decomposition and reformulation. By Identification, we mean recognizing tbe problem as one 
which has previously been solved, or noticing that .the current problem is a direct special case of * 
one whicyhas previously been solved. By decmpotltlon, we mean dividing tne current problem 
into sub-problems jhich are (hopefully) easier to solve. The third category, reformulation, refers to 
transforming the problem description into an alternative form whose solution Is equivalent to, or a 
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' '• . • . 

least a stepping stone towards/the solution of the original problem 

2.1. An Augmented Trjeggtlon Network for Wannlnt <" 

Before pretexting additional detail concerning our classification of planning techniques, it 
may be helpful to introduce the manner in, which our definitions are formalized via representing 
them in an ATN. Figure 2?rovWes a global view of RATN, snowing the connections between the 
various planning stateVr The stage is set by conceptualizing our planning taxonomy as a decision 
trot est alternative plans. The decision process is mddeled by a corresponding flnltt state transition 
diagram each named plan type in the taxonomy becomes a state in the transition graph; each 
"subset link" becomes, an arc. * 

^This planning taxonomy (decision tree) I reconverted- to proceduralfjywf by j^e following 

augmentations:- \ * 

i * • 'V ... . 

"NO Registers: Several registers are Introduced to carry the semantics of the problem 
solving process. This includes the specifications for the procedure currently 
* being'constructed (Model), and the currently proposed solution (S). Figure 3 is 
a Jist of the reglsters^whiclf are used in this report. 

(2) Arc Ordering. The arcs emanating from each node (representing alternative 
planning decisions) are ordered, thereby defining i backtracking algorithm. 
The default ordering from a given node is clockwise, beginning at the entrance 
point of the fofoming arc. This ordering entbodtes prior judgments about the 
relative simplicity and probability of success of alternative planning methods. 

r Arc Predicates. The basic arc ordering is supplemented by associating 
conditions (predicates) with* arcs/ In the ATN formalism, arc predicates are 
employed to determine the legality of a transition. By examining the contents ' 
I of the registers, these arc predicates can make -planning choices more sensitive 

to the problem context 

(4) Arc Actions: The contents of the registers may be modified by actions 
associated with various ares. The actions are performed If and only if the arc 
Is followed. " • 

(5) Linearization Cycle-.'Tht nature of nonlinearity is carefully examined, and. as a 

. result, a linearization cycle is Introduced. Thl» involves the arcs from the <. 
CONJ state to the NLC and NLD states in figure 2. If the arc from CONJ to 
NLD is Mtowed.jfor example, the M register is altered to reflect a non-linear 
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Example Registers : 

Register M - Predicate logic probleA description 
Register S - Current solution (jftan derivation) 
Register Goals-£ u *rent set of subgoals ' " 

Exagiple Conditions : m . 

• Me-tibrary - "Is problem description matched # by 

anything .in the ansKer library? 11 . 
Generic (M) - "Is the problem description repre- ^/ • 




M ^Reformulate (m) 



sented as a generic element?'! 



Exa mple Act ions : 
Goals + "7est Goals-'Set register goals to. its current 
| S ^s v contents'minus .subgoal C • 

'S^-L ibrary (MP - "Return the soiuMor found in 
the answer library." 
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Flourt 3. Ksalsters Used by PATH 



N -- The problea specification or nodal. 



3 -- in* currant solution. 

urn! 



CAVEATS A ,11st or warnings regarding possible error* geaereted during 
planning to aid In later debugging. 

V* *'• ' 

ADVICE 



\ 



A list of racoaaendttlons to guide the planner In subsequent 
decisions. Constaalnts on the. order, of Invoking subprocodures, 
for exaaple, are recorded In this register. 



GOALS — The ^et of subgoals whose solutions are currently pending. 

0 — The current subgoal, which, Is about to be solved by a recursive call to 

pain. ; ?% . 
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decomposition' (as explained shortly). 



\* , (6) Reflntnunt Loofr^ sequential refinement loop is Introduced, which selects a , 
'* S 'glutton wd*r for subgoals in^recurst vely solves f oV them. ^ 

•. . ' , . ;>^. .• 

The resUlt^j^fei* tT%Wmbrphosis is the augmented; transition network for planning (PATN)* 

^Z P/<fT>r» Plan Nod* . • >> ."■ * 

■ ' * . * ' ' » . ' v 

• Method consists' entirely in properly ordering'and, arranging the things to which 

we should pay attention • ■ 

« Descartes, QEuvresj vol. X, p. 379; "Rules fornthe Direction of the Mind* 

^ (Rule V), frortJPolya 1965, p. 77 J . ' ■% * ' 

, % . PATNji first planning 'choice invotSs selection between, the major catef^ifcs of identification, 

' . decomposition', and -reformulation. We now consldeMiow this first part of the.plan'ning process is 

. represented |n the ATN (figure 4).' The arcs In the figure have been labelled by small letters to 

• - «' 

^ facilitate discussion. Arc a begins the planning process by setting tl to the formal description of 

J) the.p/oblem. Arcs b, c and d are the possible transitions from the PLAN state. *#*he default 

^ordering Is \or IDENTlf IC-AT^tf to *e attempted before DECOMPOSITION or 

.**» REFORMULATION. This reflects'the heuVistic judgment that It is preferable to check If the 

* . f answer is already known before attempting to decompose the problem into subgoals or reformulate 

. the problem description. F « 

\ Iv " ) • ' • ' » 

X \MciJe6rn PLAN to IDENTIFY has an arc constrtlnt. Identification Is pursued only If the 
problem model 11 can be found In the answ* library." If it an, PATN" wlHj&ecute arc e. Here, S, 
* the solution register, is set to the answer found in the library. The POJTcauses PATN to return 
wtthNjp antwjr. There are no' arc ^predicates on arcs c or d because DECQM POSE and 
^REEORMULATE ire intended to t* applicable to any model. Section 2.3 pursues the discussion 
0 . by- folk) wing arc b. * 
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2.3. Probim Identification v ' 

•. From desire ariceth the thought of some means we have jseen produce the like of 
thet which we aim at; and from the thought of that, the ihougU of means to that • 
meant end so continually, till we come, to some begirmingfwithiffiour own power. 
Thomas Hobbes, Leviathon (Chapter III), in [Pofya 1 965, p. 22). 



Probltm idtntlflcatlon it the minimal technique required fcjr solving problems: retrieval from 

: . ' 

a library of known solutions. (This is not to say that there are no subtleties involved in designing 

* » '• ' . • 

this component of a procedural problem solver.) The power of the techniqy^rises from: (») the 

extensibility of the library; and (b^the manner injyhich solutions are indexed by their problem 

descriptions, to facilitate retrieval m appropriate situations. 

The answer library is initialized with the primitives provided by the problem domain of 

r ' . . 

interest, described by their- effects. Each problem which is subsequently solved is added to the 
library. 5 The answer library thereby grows In -breadth with each successful problem solving 
episode As a result, a problem which could not have been solved In reasonable time initially may 
btcome realistically solvable later, when one or more of its sub-problems have been solvedf and 
rary. 



/ 

added to the library. / 



to the^br 

Tf develop problem Identification rigoroqsly, a precise description of primitives and problems 
is required. Jot our purposes in this report, a problem is represented as a conjugation of assertions 
about a sit of objects, their properties, and their relationships. This formal problem specification is 
called the model? This is a traditional method: although we use a different notation which ^ 
find more convenient, our models could be straightforwardly translated into statefnents In the 
.^predicate calculus. 7 * 

Entries in the answer library have two parts: a Pre Model, and a Post Model. The Pre 
Model is a ^otyunction of assertions which are prerequisites for the entry: the entry ii not 
guaranteed to work if these assertions areliotHettisfied. The Post Model is a conjunction of 
assertions which describe the effect of the entry: the goal which it is to accomplish. <Thli 

♦ 

i. 

4 
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% approach is analogous to the definition of o factors In STRIPS (Fitter et at. 19721) For PATH, 
primitives afcd problems are <n<f*x#<* by their Post models only. 9 . , I 

< • , \ ^ * • ; ' 1 « 

To illustrate the use of predicate giodejsjQrM^ the answer'library, let us consider the 
primitives for the Logfp turtle worfd. The turttTts a graphics cursor on a display that is moved 
y primarily by two commands. FORWARD an^ RIGHT. The former mov.es the turtle display Jn 

.the direction of its current heading. The latter rotates ttifc turtle around its own axis. Like any 

S : * " ' - / 

problem, the primitive FORWARD is described in th^answer library by a Post Model that 

- Indicates iu ef f ecu; i.e., jvhat it can be used for, and a Pre model that statejf ks prerequisites. 

Prt Model for (FORWARD X) * ; 

* *■ 
To execute (FORWARD X), two objttts must exist: a turtle tnd a display. 
$ TheU two objects must satisfy the relationship that the new position for the turtle 

(as specify***} the Post Model) lie wlth'tyJie boundirU? of the display. 

(EXISTS TURTLE) 
(EXISTS DISPLAY) . t 
(< HXCOR (FORUARO X))| Xwax) 
.(< | (YCOR IFORUARO X)H & 



/ 



ARDX 



K Post Modtl fiff ftFORWAtw X) 

The result- of executing (FORW/iRb X) Is that there exists a vector with* length 

nd whose visibility is 
tht previous value.) 



X, whose direction is the previous headln^of the turtle and whose visibility Is the 
previous state of the pen. (Dots ( m T) are used to indicate tht 



(EXISTS VECTOR V) 1 . 

"(- (LENGTH V)'X) 
(- (XCOR TURTLE) ■ «f 

* (♦ t (XCOR TURTLE) (• X (COS * (HEADING TURTLE) ))) ) 
4 . (- (YCOR TURTLE) 

. (♦ i (YCOR TURTLE) (• X- (SimHEAOING TURTLE) ) ) ) ) 
(- (HEADING V) : (HEADING TURTLE) ) 
(». (VISIBILITY V) t (VISIBILITY TURTLE)) 
. . 1 ' . \ 

Problems *re represented similarly. Figure 5, a "wishingwell picture" is a typical scene that a 
Logo student might attempt to accomplish > by manipulating the turtle. This kind of project It 
commonly undertaken by beginners after (wo to five hours of experience with the computer 

. . ' - ' ' ".: • ' c 
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. * FIQURE 5. . 

WISHINGWELL PICTURE 
* AN ELEMENTARY LOGO GRAPHICS PROJECT 

: _ 
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CC. Goldstein 1973. p. 231 An English 'statement of the problem might be draw a wlfhlngwtll with 
• jftiare wtlt and <r triangular roq^Toallow formal treatment of this problem, we use a predicate 
(Post) model of the desired picture as input to PATN. The model is expressed in a simple 
assert tonal formalism devetopedfby Goldstein D9741 9 

t 

MOOEL UISHII 
• 1 PARTS ROOF POLE UELL 1} 

2 TRIANGLE ROOJn 3 1INE POCEi** SQUARE UELL . 
: 5. ABOVE ROOTPOLEj 6 ABOVE POLE UELL/ . 
7 CONNECTED UELL POLE (AT Pr 

8 (• P* (MIDDLE (UPPER (SIDE UELL))))' 
' ,' 9 (- P (LOUER (ENOPOINT POLE))) 

18 CONNECTE0 POLE ROOF (AT Q) 
' t-U (- 0 (MIDDLE (BOTTOM (SIDE ROOF)))) 
' ( 12 (- 0 (UPPER (ENOPOINT POLE)]) 
13\H0RIZ0NTAL (BOTTOM (SIDE ROOF) ) 
' 1* WOR I ZONTAL (UPPER (SIDE UELL) ) "~ *- 

Later we attempt to show that tfie-partlculV/cWce of model fs not critical: PATN has been 
designed to utilize a variety of heuristics for reformulating the model If necessary 10 ^0 
For the blocks world. tWbask Instruction to the one-armed robot U (PUTON A B). «JT K 



Modells: 



and B are blocks. The Pre 

To execute (PUTON A fl) , A'Auet Have a clear top, In order to be 
picked up. A eutt be at aoee knoun oldjwei tion. Aleo,- the top 
" of B euet have enough rooe for A. 

• • • • \ 

(CLEARTOP A) * 
.(ON A OLO-POSITION) A 
(SPACE -FOR A BY \ 

The Post Model asserts. /[ i 

Block A is ^ longeron i to old pot 1 1 ion. vVle on B. Aleo, the 
top of B ie not clear. 



(NOT (ON A OLD-POSIT I ON)) 

(ON A B) s ic 

(NOT (CLEARTOP B) ) 1 ° 
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For basic blocks world problems, the model is simply a conjunction of QN relationships. For 
example, a tower of tfifee blocks would have the model: 
(AND (ON A B) (ON B CM. 



2-4. Problem Pecompoeition ^ t 

» Divide each problem that you examine ii^o at many parts as you can aryd as you 

nnd to solve them mor % aasHy. 
* Oescartas, OEuvres (vol. VI), p. IS) "Discour* de la Methode" (Part II). 

This rule of Deacertes is of little use as long at the art of dividing ... remains 
unexplained J. By dividing his problem into unactable parts, the unexperienced 
proble^-totver may increase his difficulty. 4 
Leibnitz, "Philosphische ScKriften," edited by Gerhardt, vol. IV, p. 331. N 



( 



From [Poly* 1965, p. 129). 

1 



Our theory of planning addresses Leibnitz' criticism of Descartes by developing more 
precisely the nature of decompositkvtechniques. The planning taxonomy identifies two important 
methods: cmjiinetim and ^petition. The first type of plan is appropriate for achieving a goal 
r- * which is described as a simple conjunction of jpredkates (such as th* three-high Tower above). 
The second plan type is appropriate for ^chifving a goij which is described as ^ particular 
subgoal repeated some number of times (such as a Tower of arbitrary height).. In conventional 
'programmttVii»luH es * hel€ P ,an *7P fS ar . e wnplenpnted u** n g sequencing and Iteration (or 
recursion), although ether language constructs are possible (such as parallelism). 

PATN's decUlon to pursue CONJUNCTION versus REPETITION Is based on the form of , 
the model. For our purposes here, a given sub-model is restricted to being either explicit or generic. 
The former has an explicit list of parts. Wishing*fcll is an example of such a model The latter 
uses quantification to describe the overall model in terms of a. "generic" part. EQUITRII and 
EQUlT Rl? given^elow are two equivalent models for an Equilateral triangle The fifcst is explicit 
while the second is generic. 

' <v ' 

ERIC . 11 
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- •" . - ' ... . / /-> 

MODEL EQUJTRll - MODEL EQUITRI2^ ^ 

1 PARTS SI S2 S3 R1.R2 R3 ' , 1 PARTS <S 3) <R 3) 

. . 2 LINE Slj L*NE S2v LINE €3^ 2 FOR-EACH I, LINE Sill 

3 .ANGLE Rl , ANGLE R2, ANGLE R3 3 FOR-EACH I , ANGLE R ( I ) 

4 SI- 52* S3 . > . 4 FOR-EACH I, 1-1,3. . • f . 

5R1-R2-R3 k Sill - SU+1 MOO 3) 

6 CONNECTEO S1S2 S FOR-EACH I, R<|> - 128 

7 CONNECTED S2,S3, * G FOR-EACH I, i 

8 CONNECTEO S3 SI CONNECTEO S<l) SII+1 MOO 3) 
END END 

Because of the simplifications we have Introduced, generic models can br trivially 

• \ ' V ■ - 

distinguished from explicit models by the presence of the quantifier "FOR*-EACH>" In the general 
case, models could be arbitrary logical expressions with mixed existential and universal 
quantification. The elementary blocks world tasks and Logo picture problems wMch we are 
considering do not require this complexity. (A direction for future research is to extend .PATN's 
design to handle these more complex problem' descriptions.) — ' * 

The ATN representation f^r this decision is illustrated t>y figure. 6. Examine the 
DECOMPOSE node. The transition to CONJUNCTION is made only if the problem is 
described by a model with explicit parts such as EQUITRII or WISHING WELL. If the model Is 
constructed from a generic description at In EQJLIltRI2. then REpETITIQN is selected Thus, In 
terms of arc predicates, the alternatives at the DECOMPOSE node are mutually^cchislve. It Is 
possible that a REPETITION plan, for example! might eventually be produced for a -problem 
initially described by afoexptkit model. However, this would occur only through an intermediate 
REFORMULATION fn which EQUIVALENCE converted the original model to generic form 
This in turn would allow a recursive calLto PATN in which DECOMPOSITION wouM then 
choose REPETITION. , . . . . 
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EXPLICIT (M) 



DECOMPOSE 



! 



< 



GENERIC (M) 



• c 





V FIGURE 6 
PATN'S DECOMPOSE NODE. 
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2.5. Decomposition by Conjunction 

For conjunctive plans. PATN'i next design decJiJpjHl'whether the conjunct! are to be treated 
^Independently, or, alternatively, whether notice must be taken of Interactions. For example, a lltumr 
pkQ fdr the wUhingwed of figure 5 would solve for the three sub-pictures - ROOF, POLE and 
WELL -- as separate subprocedures, each constructed independently of the others.. A nonllntmr 
plan might attempt to take account of the potential Interactions between POLE and the other parts 

* ♦ it 

- modifying the specifications for ROOF and WELL so as to start and stop in the middle of a 
side - facilitating connection with the POLE. However, slnce^ch an optimization retires that a 
given subprocedure Incorporate knowledge regarding the implementation of another subprocedurc, 
t a Hntcr plan would not do this. * 

« 

Let us be more precise In our classification of nonllnearltles. The goal is to construct a 
procedure to accomplish a con>mct/on of assertions. NonUn-rUUs In decomposition are those, that 
add constraints to the design of the subprocedures. Nonlln*orltUt in composition (i.e, in putting 
, the pans back together) are those that add constants to the design of the superprocedure. 

For the wlshingwell example, adding the constraint to the design of the subprocedures for the 
ROOF and WELL that they start in the middle of a side is an example o^a nonlinear 
decomposition.' Another example for the Logo world - which Involves more than optimization - 
occurs for problems wltkh specify that one object. X, is to be INSIDE another, Y. Y must be larger 
than If.the required topological relation is to hold, f hlf means that a linear decomposition that 
Ignores the INSIDE relation and draws Y to some default size is ijkely to fall. The correct 
approach is to add a SIZE property to the descriptions of both X and Y r; - 

A nonlinear composition adds constraints to the design of the superprocedure. For the blocks 
world, the most common form of this nonllnearity Is the existence of a partial ordtjng on tht 
stouonctXt which tht suogools should bo achieved The ordering constraints arise from the use of 
some temporary cesounx (such as space), by one subgoal, which ^eventually used in a conflicting 

\z • ■ 
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way by another. An example discussed by Sussmah 0973] and Sacerdotl D975] Is 'the construction 
of a tower of three blocks. I.e.. (ANO (ON A B) (ON B Cl^ The t|bwer must be built from the 
bottom up if the subgoals are not to conflict. The constraint (BEFORE (ON B. C) (ON A B) ) must 
be added to the design of the superprocedure. 

The. same kind of nonllnearity an arise In - Logo animation. To create a "snapshot" of some 

' L » ^ ' 

picture which can be'displayed. anywhere on the screen, the picture rnust first be drawn and 

i 

"photographed." This process, called "snapping." involves first drawing th'e picture^ next snapping 
It. and then erasing it. Now the erasure is of an entire screen region. If another shape is present it 
will be destroy*!. Hence, no shapes intended to appear in the final scene should be present. Thus, 
a constraint must be asserted that requires that the snapping subgoal be achieved before arty 

subgo*]*^+tffdrtw a permanent shape In the critical screen region. 

/ 

Nonlinear decompb^tlon^^ composition constraints are not^miu^aUxexclusive. A given 
problem can exhibit both kinds of interactions. In the next sub-section, we take amount of ttQ by ♦ 
including a cycle In the ATN that progressively linearizes each interaction detected in the mod?f. 

2.6. PATKTt Subgraph for Conjunction 

Figure 7 shows PATN's subgraph for conjunction. Arc b from CONJUNCTION to 
LINEAR decomposes the model into sub-models that will be solved for independently by recursive 
calls to PATN. This is done at fbllows. Two classes of sub-models are created. One elass 
describe! the individual objects The second class describes interactions Jbet ween pairs of objects 

♦ For each object X* in the model M, Mi is the jub-model composed of all the 
assertions in M describing properties of Xi. ' 

• For each pair of objects XI and Xj in the model M, Mi.J is *he sub-model 
composed of all the assertions describing relations between Xi and X J. 

We speak of accomplishing ihe object Xf described by Mi as a pain stip in the overall procedure. 

Relations between two objects' described by Mij are accomplished by'lnterfaee steps. 



M i,j.\ A v x iV 




i) 



(2) 



A NLD(tt) 



Anlc(m) 




0 



—f 

NONLINEAR 
-J[ DECOMPOSITION 



M<-M A Pgt^) A P m (X j ) 



NONLINEAR 
>J COMPOSITION 




\ 



ADVICE^ADVICE A CONSTRAINT 



RIGURE 7 
PA*TN's CONJUNCTION NODE 
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A* an example, a linear decomposition of the wishing well is: 

' Ms TRIANGLE ROOFj t ' ■ " 

HORIZONTAL (BOTTOM. (SIDE ROOF)) 

M2t LINE POLEj ' . 1 „ 

H3t SQUARE UELLi ' 
HORIZONTAL (UPPER (SIDE HELD) 

HI . 2* ABOVE ROOF POLE* 

CONNECTEO POLE ROOF (AT Q) /. 
(- GMMIODLE (BOTTOM (SIDE ROOF)))) 
•(* Q (UPPER (ENOPOINT POLE)))- 

« * ^ 

« M2,3« ABOVE POLE WELL 

v \ CONNECTEO^MELL POLE (AT P) 
( - " U P. (MIDDLE (UPPER (SIDE UELL)))) 

U P (LOWER (ENOPOINT POLE))). * . 

♦ • * . ' . 

» « ' 

We define ilnkar sequential refinement as solution by the following process: 

• * * ' «■ 

(1) organize the maihsteps into a sequential procedure, choosing an ordering that satisfies anr 

linearization advice-, I \ , • ' 1 

(2) solve for the malnsteps independently; 

(3) solve for the Interfaces In the order in which" they occur In the procedure; 

Itr' 1 

A linear decomposition is valid if a corresponding solution via linear sequential refinement It 
possible. Implicit interactions can invalidate a linear decomposition 

The linearization cycle consists of arcs c/ and arcs d,g. These arcs attempt to linearize the 
model by checking for known types of interactions. The nonlinear decomposition node adds 
properties to the descriptions oK Individual sobgoals that take account of Interaction*. The 
nonlinear composition node sets an advice register that will be accessed by the SEQ, operator 
(explained below) in constructing the superprocedure. 

NLD Is a conjunction of conditions (predicates), each Of whChlhecC the model for a 
particular relation or pattern of relations that have nonlinear consequences for \t decomposition. 

26 
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• t t X 
If anjjet thes^pred kites detect their kind of Interaction, properties a)re added to the description of 

Indlvlduil objects tbat\e^licitly <«ccovnt for the dependency. The objective Is that with these 

additional properties^ independent treatment of the modified object specifications will be 

successful 

For example, as discussed above, INSIDETs a relation in the turtle world that has 
consequences for the properties of the objects involved. Thus, NLD-INSIDE checks for the 
existence of (INSIDE X V) in tty model If found, SIZE propertied describing X in terms of Y, 
or Y In terms of .X, or both, are added to the properties of theje objects. The re$u| is that an 
Independent solution for (the revised versions of ) X and Y wtH mk prevent tffe INSIDE relation 
from being accomplished. ^ 

NLC checks for patterns tn ^he model that have consequences for the eventual cof%otltlon ot^ 
the s^ibgoals. If such properties are detecti^flthen explicit relations are ^ded to take, account, of 
the Interactions. *An example is NLC-ANIMAT IpN that checks for a Logo animation that creates " 

snapshots and shows thfm. If detected, (BEFORE SNAP DISPLAY) is appended to the contents of 

* * 

the ADVICE register. Similarly, for the blocks world, NLC-TOWER adds (BEFORE (ON B CI 
(ON A Bl ) to ADVICE. • ' , \ ^ 

The NpC a\id NLD constraints arise fron^Xsources. The first is that they may be^ 
Supplied by the creator of the Planning ATN. Alternatively, following Sussman [197)1 PATN can 
be designed to summariie bugs by classifying the nature of th? notftllnearity and adding It to the 
NLC and N ^constraints. In these terms,' the acquisition of rttUI iC^Hwst partly, the growth 
more elaborate recognition ratines for implicit interactions. Sussman called this process the 
compilation ^critics. The theoretical advance of Structured Planning over Sussman's HACKER 
.paradigm is toinafce clear that thesejerittes are simply additional arc constraints^in the planning 

transition gfcaph. They are noidif f erenf in kind from any other planning constraints. 

• , " -, . ' ' ' * 

To summarixer implicit dependencies are handled by the ATN's linearization loop. If the 
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^ problem U Identi/ied as involving some kind of nortlirteariiy, then the model or ad^jjegisters ajj^ 
modified to make the interaction explicit Processing then returns to the CONJUNCTION node, 
Further processing of interactions occur* until no more are detected. Control then passes to the * 

„ LINEAR node for actual dkomffexUipn* If an Interact^ still exists, but has gone undetected, 
subsequent debugging will be necessary. 

. Composition by Sequential Refinement 

*\ 

Once the nonlinearity loop has been completed, PATN would go on to solve the individual 
subgoals and compose a compky solution. In this section, we discuss a composition technique we 
term sequential refinement. A generalization of this approach, net refinement, based on thej 
procedural net representation for programs/Is discussed in section three. 

Figure 8 illustrates the ATN subgraph for the sequential ref inement cycle. The basic proceu 
Is cycling through the subgoals identified by, the linear decomposition and solving for each by 
recursive application of the ATN. Arc b enters the sequential refinement loop. The solution 
register S is set to a sequential superprocedure for the mainsteps Mi and interface steps Mi J 
identified by the decomposition. The SEQ, operator on the arc chooses an order for this 
superprocoflure thatpit consistent with any ADVICE recorded by the linearization loop. SEQ 
rtight also bring additional criteria to bear on the organization of the superprocedure, such as 
imposing an order that mirrors chains of predicates in the model, such as X connected to Y 
connected to ZThh often simplifies interfacing. 

As an example, for the wishingwell problem, given the Mi and Mij specified above, ft 
plausible sequence of mainsteps would be 

. TO UU ~ \i 

16 ROOF ^ 

- * 2e POLE 
~ % ' '38 HELL ' 

END .* 




S -SEQ{Mi,Mij} 



3oals«- ORDER* {Mi, Mi j} 
b 




Goals - Nil 



POP S 



G + First Goals 
Goals •*■ Rest Goals 
SEQ(G) + PLAN (M+- G ) 



c 



FIGURE 8 
SEQUENTIAL REFINEMENT 
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The ORDER operator on ar* b of figure 8 chooses th» sequence in which the sub-problems 
are solved. This may not be, indeed, probably is not, identical to the order of occurrence of the 

« * * 

sub-problems In S. A criterion for the ordei- of solution, for example, is to solve-for the mainsteps 
before the Interfaces. Another criterion is to order the majmteps with respect to their complexity. 
Lookahtad (sectloh three) can estimate this. Fir the wishlngwell, it makes sense to solv* for the 
POLE first since tookahead can* identify this as a primitive. Criteria for ordering the relations 
can exist as well, although the default ordering is usually the order of occurrence in the procedure. 

Arc c 0a cycle that recursively solves for thesubgoats in the order selected by ORDER. The 
solution for each subgftal is attache^ to S at that subgoal's node. The solved subgoal is then 
deleted from COALS. When ail subgoals have been solved, the cycle is exited via arc d. The 
ATN pops, returning the solution. 

* > - r ' ' 

i ' t 

For increased effectiveness, PATN's initial Logo world answer library would contain both 
primitives with their associated models as well, as schemata for accomplishing particular model 
relation. Thus, if the sub-problem is to;gchieve (ABOVE X Y), where X and Y are mainsteps 
that have already been solved, then the answer library would contain specific procedural 
knowledge for designing an interface, relative to the adjacent mainsteps, that satisfies that 
relationship. The nature of these imperative schemata is discussed In [Goldstein 1974, Appendix 
Dl We do not give detail* here. 

For the wishlngwell, the mainsteps for the ROOF, POLE and WELL would be solved first 
Then, pursuing the default order for relations, first the interface between ROOF and POLE and 



ERIC 



then between POLE and WELL would be constructed. Figure 9 shows PATN's solution (as hand* 
simulated by the authors) and the sequence of ATN states involved in its generation. 

Besides generating the program, PATN would generate its annotation, an hierarchical trace of 
the ATN states passed through in generation. In this derivation tut, each node has a copy of the 
values assigned to the registers at the time thettode was generated. This serves as a description of 

^ ' • . • * 31 . 
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►DECOMPOSE 

■KXXWUNCTIOH 
-LINEAR 



►POP(S) 



WHERE S IS: 



TO WW 

10 M, 



TRI 



ROOT 



20 M 



1.2 



30 M. 
40 M 



2,3 



+ BELOW, CONNECTED 
LINE ♦ POLE 

- BELOW, CONNECTED 



50 M, * SO. A- WELL 



* . , FIGURE 9* 
SOLVING THE WISHINGWELL WofiLEM 
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the purposes of the code in the form of the MODEL assignments, ADVICE for future 
.modifications and CAVEATS regarding possible bugs. Caveats are generated by the planner 
when making possibly erroneous heuristic decisions; these are discussed lo a later section on 

debugging. The derivation tree for the wishingwell procedure (abbreviated slightly) is illustrated 

■t . % ' . " f 

In figure K>. . 
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2.8. paytBBOgjtloB by Repetition 

Before concluding this section, we briefly consider other planning techniques which were * 

v ; 

illustrated in our taxonomy but have not been elaborated in the discussion jo tar. Repetition plans ' 
correspond to the problem solving method of structuring the solution in terms of either the same 
goal applied to simpler arguments (recursive plans) or another simpler 1 goal repeated some number 
of times (round plans). The former technique is more, powerful than the latter in the sense that 
every round plan can be accomplished by means of a recursion, while every recursion cannot be. 
accomplished by iteration [Hewitt 19721 Jlut Round plans are differentiated because the problem 
formulation which would trigger them for PATN differs from th%t of Recursive plans. In the 
former case, the problem P 4s described as n repetitions of problem Q, where Q}P, while In the 
latter P is described in terms of repeated occurrences of problem Q»P. * 

, y 

* Round plans are the natural planning technique for generic models. We intend to handle this 
in the ATN via an arc^ operator ROUND that formulates a sub-model for the generic part and 
advice for the composition requesting an iterative control structure. Having decomposed the 
problem in this fashion, control would -then pass to the Sequential Refinement Loop. Figure II 
Illustrates this subgraph. • ' 

EQUITRI2 was an example of a generic model. The ROUND operator would liolate 
subgoals for accomplishing a SIDE and a ROTATION The repetition advice would be for three 
Iterations. The rem* w^uld be a program of the following form: 

v * . - •• • 

90 W , / 
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ABBREVIATED HIERARCHICAL DERIVATION TREE FOR WISHINGWELL 
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FIGURE 11 
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2.9, grojbjgg Reformulation 

When a problem arises, we should be able to see soon whether it will be 
profit sole to examine some other problems firpt^and which others, and in which 
order. 

Descartes, OEuvres (vol. X), p. 38UtBuias for the Direction of the 
Mind" (Rule VI), from (Poiya 1965, p 3f 

The final category of plans which we conside^fosists of techniques for problem 

reformulation." The importance of these methods can be understood by recognizing that all of the 

problem solving strategies mentioned above are triggered by pattern matching against the 

* ■ A 

description of the problem. The reformulation techniques, however, are designed to after the 
problem description; PATN would apply these reformulation techniques should solution by 
Identification or decomposition fail Tj<8l^ctlon is to reformulate the probtem^description, and 
Chen to pass the new description back .to the Planner. 

Oyr taxonomy includes two reformulation techniques.'^ The first attempts to find ah 
equivalent ^problem that will be easier to solve, and whose solution will satisfy the original^sk. 
The second searches for a simplification that can be iped as a stepping stone to solving the original 
problem. ' 

The difficulty in applying reformulation plans lies in recognizing which reformulation will 
aid the solution progress. For equivalency, we envision PATN as capable of reformulations that 
move between descriptions given in terms of multiple objects^ equivalent descriptions in terms of 
a single generic object, thus changing from a Conjunctive decomposition xo a Repetitive 
decomposition, or vice versa. An example is moving between the EQjJITRII and EQUITRI2 
triangle models. Another reformulation technique involves regrouping the parts. Figure J2 shows 
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an example of parts regrouping for the wlshlngweW. The virtue of regrouping Is that It might 
produce a model whose pans are already In the answer library. ' 

For Simplification plans, we have analyzed elementary techniques based on genera Hut ion. 
specialisation, and analogy, (a) Specialization typically involves instantiating variables in. a model 
by specific constants or restricting their range. (b) Generalization would include the opposite 
processes. Other non-equivalent reformulations Involve adding or deleting model predicates, (e) 
Analogy often amounts to first generalizing and then specializing. Thus, for the Logo world, If 
the original model were for a^ftangle with sides of a certain size, generalization might produce a 
model for a polygon, or for a triangle of arbitrary size. Analogy might then respecialize to a 
square, perhaps, or^aortahgle of another size. The virtue of these reformulation techniques is the 
possibility for reaching a problem description whose solution is known. We envision that each 
technique would have associated with It an inverse mapping on the solution so that it can be 
mapped back to suggest a plan for solving the original problem. " 
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3. Searching tor the Plan 

If you tee several plans, none of them too sure,, if there are several roads 9 
dlvertlnf from the point where yoy are, explore a bit of 1 .each road before you 
venture too far along any one -- any one could lead you to a dead end. 
Polye, Mathematical Discovery, (vol. II), p. 27. 

i « 

the most straightforward plan generation algorithm for PATN is to attempt arc transitions 

in depth first order, with alternatives stored on a backup lisfc If some plan leads to a subgoal that 

» • 

cannot be solved, failure occurs. Control backs up to the more recent choice point, and planning 

* ^ * 

resumes by pursuing the next«ontried alternative for that choice point (provided that it is allowed 
by any arc transition constraints which may be present). J 

» * This depth first search would apply to both explicit and implicit choice points in planning. 
An example of an exptictt choice is the decision between decomposition and reformulation for a 
gIVen problem.- By implicit dheict point, we mean those decisions which arise which are not 
represented as mutually exclusive arc transitions Ih^ATN. Implicit choices occur in identifying 
past solutions (more than one previously solved problem may match the Post model for the current 
problem); creating super-procedures (there may be more than one reasonable sequence); and. in 
general, whenever knowledge on the transition arcs sets reglsterrand makes decisions. We have 
discussed arc ordering and predicates associated with the transition arcs to djlrect explicit choices In 
the planning ATN. For each implicit decision, a simila Approach is possible. The decision 
process locally determines the order of the alternatives, pursues the first, and pushes the remainder 
onto a failure stack. Thus the overall planning process would remain a depth first search. 

Ultimately, all plans which PATN Is capable of generating would be tried in this mode. Of 
course, exhaustive backtracking search is not a practical planning technique. One way of 
decreasing aimless search which has been discussed is to provide additional constraints on the 
transition arcs. This section outlines further techniques germane to resolving planning decisions. 
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These techniques operate by superimposing an executive search process on the ATN so as to 

* * 

Improve the efficiency of plan generation The techniques represent four milestones In the 
development of a successful planning theory. These Improvements, designed to make the planning 
, process morydtfect^d and less susceptible to blind search, are: (a) lookahtad (e g,, [Aho k , 
Ullman 1972]); (b) lust cmmltmnt (e.g, iSacerdotl 1975]); (c) dlfftrtntiat diagnosis (elg.,- 
[Rubin tSKth and*(d]j/iinma librarlts (cf, mecro^r [Fikes etal. 19721 wtll formtd substring tabtts . 
tfcuno 19671 (Woods et al. I972D. We Intend* to incorporate these strategies into the basic PATN 
' problem solver, following Its initial implementation. \ 

3.1. tookahead r 

Lookahead consists of a limited search of available .alternatives, with associated static' 

plausibility criteria for Judging the probable >uccess of a given non-terminal state. An elementary 

but Useful form of lookahead touM be accomplished ln 4 PATN by pushing the planning process 

forward some fixed number of recursive levels, looking to see if .a solution arises via identification! 

Thus, a decompose tbatcan solve most of Its subgoals in terms of the answer library, would be 

preferred to a decomp<Wti^^ recursively apply decomposition techniques to its subgoals.* 

* In effect; such lookahead attempts to select those plans that accomplish the jgoal with a minimum 

nurib^r of recurirve calls to the problem solver. \^ 

v , For example, reconsider the wishingwell scenario. Suppose the answer library contains, ngkVa 

& ' * * * * 

•' TRIANGLE program, big a TREE procedure. Lookahead could prevent the planner from blindly 

- pursuing- a decomposition in termr'of ROOF, POLE, and WELL,' over a reformulation that 

describes the wishingwell as a TREE and a WELL (figure 12) This wolld be accomplished by 

observing that the reformulation produces a .problem descrtptionTwhose decomposition' can be 

partly- solved by means of the answer library; whereas the standard- decomposition results in two 

0 :w . • \ ' - J 

* ; subgoals (the IvOOF and the WELL) that require further analysis. -' ' 4 K ' * . 
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Lookahead could be Implemented in the usual fashion (see, e.g., [Aho k Ullman 1972]). A 
J^utk plausibility function rn^t assign a plausibility of one to problems that can be solved via 
identification, ^iruJ zero to problems that require decomposition or reformulation. Lookahead / 
would push the analysis through a fixed nOmber of levels of recursion, and then estimate the 
dynamic plausibility as the sum of the static plausibilities of the subgoals appearing as the tips of 
the probftm tree, divided by the number of these* skoals. The division serves the purpose of 
resolving the following situation: given two situations in which the same number of subgffirti'are / 
" " known, the problem tree with fewer unsolved subgoals is to be preferred. 

A tefinement of this plausibility computation might assign greater weight to those plans that 

ltd to identifications for more complex subgoals. The complexity of a subgoal could be 

* * 

approximated by syntactic criteria such as counting the number of predicates involved. 

3,2. Least Commitment 

Least commitment is the problem solving technique of avoiding premature decisions. It is 

• •• ' * . • . ^ 

elegantly develop^ by Sacerdoti [1975] in the form of procedural nets. Sacerdoti observes that 
some bugs in planning can arise from prematt^e ^commitment to a particular sequence, when the 
available evidence does not in fact require such a determination. His solution is to represent the * 
program, not in the usual sequential format, but as a net. 13 ^ 

Figure 13 illustrates a procedural net for building a tower from three blocks. Sacerdoti 9 ! 
planning system, NOAH, proceeds by successively expanding subgoals, committing the system to a 
sequeiyce only when a conflict in ordering arises. At levels 1, 2 and 3, no order has been chosen for " 
- the sequence oLjtccomplishing (ON A |) and (ON B CI. It is not until after criticism -at level i 
that NOAH cormnits itself to an order for placing the blocks. \ ^ 

This technique could be incorporated into P^TN by replacing the sequential ref inejnent loop 

i r 

With a net refinement ' cycle (figure 14). Instead of SEQ, organizing the subgoals into a sequential 
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Achieve (AND(ON A BKON B C)) 



(a) 



LEVEL 2 



Achieve (ON A B) 



Achieve ION- B C) 



(b) 



-T A- 740622- 14 



LEVEL 3 f 
(Before Criticism) 



Clear A 




Put A on B 



6 



Put B on C 



(0 



TA-740627 15 



LEVEL 3 . 
(After Criticism | 
by Resolve Conflicts) 



Cle, 



laA 



Put A on B 



Clear — 









J 




Put B* on C 



0 



id) 



TA- 740522- 18 



„ * - figure 13 

SUCCESSIVE REFINEMENT OP A PROCEDURAL NET FOR BUILDING A TOWER 
' » PROM (SACERDOTI, 1975, P.. .15) 
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• \f - t; 

P procedure, NET would organize the subgoab Into a procedural net This leads to a generalization 
^ of Sacerdoti's approach We would represent Inf the net riot only the main subgoab as alternative 
branches unless ordering is required, but a bo thMtbttom between these goah Figure 15 shows 
the general form for such a "Structured Planning Net" 

PATN would solve for each subgoal, following the procedural net technique of node 
expansion. But eventually the planner would also solve for the relations. When all subgoab, both 
to construct individual objects, and to satisfy their relations, were satisfied, the result would be an 
executable net. Any remaining branching could be executed in arbitrary order. Figure M 
illustrates this process. The operator NET on arc b sets the solution variable S, not to a 

' superprocedure, but to a net of thj^f^hn given in figure 15. COALS is the set of subgoals, 

■ * 

ordered for ptannlng attention in the same fkshton as for sequential refinement. 

Art c recursively cafU the plainer to solve for a subgoal If the subgoal is a mainstep, K Is 
spliced into the net as a refinement But if the subgoal is a set of relations, then its solution may 
involve establishing a specific Interface If so, a sequence is enforce^ on the mainsteps adjacent to 
this interface. The effect would be that, in figure 16, A Is transformed to figure B. If there are no 
relations between two mainsteps that require interfacing, then no additional ordering will be 

a 

imposed and the net will preserve its branching. The Result wquM be Executable under the 
interpretation that parallel branches may be executed in any order. If there are a great many 
relations, then the net will ultimately reach its most constrained form - a sequence. 

Following Sacerdoti, Arc d would criticize the procedural net, checking for interactions that 
Sefe^me apparent only after expansion. A typical example is noticing that the prerequisites of qne 
are "clobbering" a brother subgoal. For the blocks work), this involves observing, by 
means of a table of multiple tf/tcts [Sacerdoti 1975, p. £091 that the prerequisites of one goal are 

Clearing a block that was placed by another goal. We shall not go into detail regarding these 

* * 

critics. The Interested reader should consult [Sacerdoti 19751 However, it is worth noting that if 
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^e original linearization was completely successful, criticism' should find no hidden Interactions. 
But His probably a useful heuristic check on the llnearlatlon cycle to include this criticism process. 

There an/subtteties In handling relations between non-adjacent malnsteps. For su 
relation such as R<XI.XS> might have to be replaced by an equivalent description In term, of 
object, accomplished by adjacent malnsteps, *ay (AND R,(XI. X2> R^.XS)). We shall not 
dUcus. this further here. Our porpo* here U *ly to indicate the direction our research would 
take in linking the ATN reputation for planning concept, to Sacerdotr', procedural net 

representation for programs. 

PATN', design represent, an extemion of NOAH, Sacerdotl', program for ref Ininf 
procedural nets, in that NOAH's primary planning technique is successive goal expansion. ThU 
corr«pond. to-PATN's deo^ttton-by^ Junction. But PATN .bo repress a variety of 
? other planning strategies Including repetition and the majo? category of reformulation. NOAH 
improve, the reputation of the procedure, produced (by 1 using net,), but dc*. not empha.lse 
PATN', central concern ^ this goal structure is arrived at. Hence NOAH make, an 
important contribution, for th^uhion In which It captures the principle of least commitment; but 
it is not a tottl theory of program composition. j C 

a.3. Dlfjgan| lfj Diagnotlt 

Differential diagnosis refers to a collection of strategies which gather specified 
knowledge at crucial choice poinV Crtt* belong in thl, category. Critic, analyse the problem 
demotion, and advise PATN a, to which transition, are permissible and which are prohibited. A 
Block's World example Is HACKER', critic (whlch.could be attached to PATH'. 
CONJUNCTION node), that dlagno*. (AND (ON X Y) (ON Y ZD problem, a, involving non- 
linear relation, between the subgoals. 
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3.4. Liwmt Ubrwri— «. 

Whenever a sub-problem U successfully solved, M an be added to the answer library* even if 
the overall approach fttta. 1 * ThU a Hows the problem solver to avoid, repeated attempt^ to solve 
the same mbcoela. Strips IFlkes et aL 1972] used wmcrppt and frf**(tV retto to achieve similar 
economies. This planning technique is analog o^s to the use of well-formed substring tables 
OCuno 1967. Woods et aL 1972] tn applying ATN'i to natural language parsing, including their 
.fOMrahtattam to cktrts. as utiUxed by Ray WK] and Kaplan DJ7S1 



In the remainder of the paper, we consider the nttonal kugt that can arise in PATN's 
planning and how they an be dtagnotfd and repaired. 
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4. 8>ruchirgd Debugging 



JLm\ us focus on one particular component of [general heuristic Knowledge]: the 
art and techniques of ... debugging. The school experience is dominated by the 
normative attitude implied by "right answer vs, wrong answer". The 
mathematician's experience of' mathematics is dominated by the purposeful- * 
constructive attitude implied by the struggle to "make it work*. He abandons an 
. idea not because it happened to go wrong, but because he has understood that it 
is unfixable. Dwelling on what went wrong becomes a source of power rather 
then a piece of masochism (as it would appear to most fifth graders in traditional 
meth classes). 

Papert, The Uses of Technology to Enhance Education, p. 10 

We agree with Pipert In his assessment that debugging Is an essential part of problem 
solving. A powerful debugging system frees the planner from the necessity of always producing 
entirely correct plans. Bugs arise from heuristic choices made in constructing the plan. From the 
Structured Planning and Debugging standpoint, sucb-htuflstlcs are embedded in the default 
ordering of transition arc* In the absence of specific arc constraints, PATN would prefer linear to 
non linear plans, round repetitions to recursion. Such heuristics can lead to bugs. But we also 
expect these heuristics to provide several significant advantages to\e planner, such as: 



v. 

(a) allowing the planner to attempt new problem types with which it has hafno 
experience, 

(b) often being successful (because the default choice happens to be correct); 

(c) In those cases where an error arises, regarding th#nature of the difficulty as a f 
specific diagnostic as to the locus of the incorrect decision and the alternative 
choice required; 

(d) sr>bu W\ibsec^t*xpCTlence lead to bugs, abstracting the problem description, 
einbeddin|Tt1na critic at the point m the planning ATN where the Incorrect 
choice was made, and thereby preventing future occurrences of the same error. 

We call the class of mistakes that arise from reasonable heuristic judgments made in planning 
" ^rational bugs. In this section, we show how this class of difficulties can be explained with 
reference to the planning theory. We introduce strategies for Structurtd Dtbugging, I.e., techniques 

t 
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for diagnosis and repair of rational bugs, based on Identifying Incorrect or Incomplete plans. We 
organize these strategies as a design for a Debugger far Annotated PRograms (DAPR)) S 

For DAP*, debugging consists of diagnosis and repair. If we envision repair knowledge 
being associated with various glasses of error, then once the underlying Xause is identified, 
correcting the program Is straightforward^ Hence, the critical problem Is diagnosing the 
underlying cause of the bug from its surface manifestation. We define a bug as being manifest if 
the program produced by a plan falb to satisfy the problem specification or model. The model 
consists of a Boolean combination of predicates over a set^objectsj^unsatlsf led predicates are 
termed violations (following Goldstein 09MB. This definition subsuines the special case In which a 
program falls to run to completion due to an unsatisfied prerequisite of a primitive operation, since 
operators have Pre and Post models. - ^ 

In terms of the ATN planning theory, the underlying cause of a bug Is either an Incomplete 
plan. Iff which a step Is missing (e.g., the sequential refinement loop has failed to identify a 
subgoal). or an Inappropriate pbn, in which an Incorrect arc transition has been made. Underlying 
* causes can also be categorized as syntactic, semantic, or pragmatic, according to whether the 
. malfunctioning planning knowledge lies in the topology of the ATN, the semantic arc constraints, 
or the pragmatic selection criteria (eg., critics), respectively. (Ft^addlttonal details on this aspect of 
the bug taxonomy, the reader is referred' to [Miller * Goldstein I976cl In which these distinctions 
are made with respect to a context free grammar mirroring the topology of the ATN.) DAPR's 
goal in diagnosis is to identify where In the planning process an Incomplete or incorrect choice was 
made 16 

DAPR is designed to employ three diagnostic techniques: model, process, and dlan diagnosis. 
Process diagnosis is the traditional kind of program analysis In which the programmer examines 
« the state of ihe process at the point where the error Is noticed. Model diagnosis goes beyond 
traditional programming environ menu and .draws upon the formal specifications defining the 
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purpose of the program. Hence, it is a natural extension of work on verification. Plan diagnosis 
is new. It is made possible by a dtrivatlon trtt being associated with the program, which represents 
the planning decisions made in creating the code. A diagnostic technique we shall not discuss that 
is useful In analyzing human code, but pot especially appropriate for programs wrljten by PATN, 
is code diagnosis. This amounts to having a list of rational form criteria, and examining the code 
tofind if any are -violated [Goldstein 1974, pp. I37-I381 .As currently designed, PATN r s set of 
planning techniques would not lead to this kind of mistake. 

4.1. Modgj Djagnogii 

Model diagnosis is the basic diagnostic technique, in that it involves the determination of 
whether the program has succeeded or failed in accomplishing its intended model. In logistic 
terms, it amounts to a verification in which the model predicates are applied to the structures - 
pictures or block arrangements ~ produced by the program.! 7 

The particular set of model predicates which are violated provides strong evidence regarding 
whether the underlying cause is an .incomplete plan: this is determined hy check^Jf^any code 
was generated whose purpose is to accomplish those predicates or their prereqtiisites. If the pUn ts 
incomplete, then repair can be accomplUhedJiyJnyoking the planner ^wpply the code. 

^ For example, suppose that after solvmejhe^wJsMn^well problem,' PATN is asked to 
generate code for a scene consisting of two wishingwells, as shown In figure 17. This scene might 
be specified by the following model: | 

nOOEL UU-SCENE 

1 PARTS UU1 W42 I - 

2 UISHINGUELL UU1, UU2 

3 RIGHT -OF UU2 UU1 

k PARTLY-BELOU UU2 UU1 • 
END • 

Both wishingwells would be accomplished by identification, that is, by calls to the existing 
subprocedure. PATN would initially generate a plan for this problem corresponding to the 
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PIGVRfi 17 - DEBUGGING A WISHINGWELL SCENE USING MODEL DIAGNOSIS 



Intended Picture 



Actual Pipture 






WW2 starts fiere 




Manifest; Violations: 

WW2 does not satisfy the wishingwell model, because the 
bottom side of the^roof i*s not horizontal. 



Cause of the Bug: 

The plan is incomplete. There is a Missing Prerequisite 
for this runtime environment. Wishingwell incorrectly 
assiimes that turtle starts out facing north. 

« 

Repair Te^hniqufc: - 

Use imperative knowledge of violated predicate (horizontal) 
to- compute missing . initial rotation. + 
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». ' « 

i* 

•> • " • 

„ following cod«£^ ' . t * 

* ' ' ' TO MM-SCENE 
18 UU 
28 PENUP 

*3a FORWARD 188, * > • ' 
W PENptftN 

Lines <^30, and*40 constitute an interface to accomplish model assertions i and 4. This code has 
bug: the second wishingwell does not correspond to the wishingwell model, because the RQ 
not HORIZQ^nJfc^Model diagnosis ^determines that, in fact, code exists In WW to accomplish 

this/property . ^However, the plan, for th'is code Implicitly assumes that the turtle starts out facing 

.w» - ' : . • - - , . v «- • 

NORTH. No' code was generated to accomplish this prerequlslte.jsince In previous uses of the 

procedure it happened, to ?hvayi be satisfied in. the 1 initial environment. Hence the underlying" 

oM^-of the bug U incomplete planning arising from an unexpected rjintime environment. The 

repair technique is to use- imperative knowledge associated with the .violated predicate to compute 

••*..,- - 
the missing Code an interface rotation step. 




V 



EDIT UU-SCENE • •* 
45 LEFT 98 

Model diagnosis can 'succeed in cases such as this, where some predicated be found for 
which no code exists to accomplish It Alternatively, if the plan Indicates that code was created to 
accomplish every applicable predicate, then further diagnosis is necessary/ Perhaps there are 
unexpected Interactions. Prjx^ diagnosis is the next stage. 18 * 
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• x \-' . • ' . 

4.2. Proem Dinwit : >f 

Examining the state of the execution process, at the point where the bug became manifest, is 
often helpful in diagnosing unexpected Interactions.' This is the diagnostic technique used by 
HACKER. Conflicts between goals are dlagnosed*s non-linearities and reflect the underlying bug 
of having applied in inappropriate (l.e.,; pragmatically incorrect) plan. The essence is observing 
that one goal has violated a model predicate describing the Intended effects of a prior step. The 
HACKER bugs of prerequisite Clobbers Brother Goal, Strategy Clobbers Brother, and 
Prerequisite .Conflicts with Brother are ill of this type. 

Sussman [I973\ develops elaborate process state patterns for classifying kinds of interactions 
which we shall not repeat here. The essence is observing that a model predicate is being undone 
within a -scope during which it is expected to be true. For example, consider the blocks world 
problem of building a tower of three blocks: (AND (ON A B) (ON B C)j. Part a.of figure 18 
(from [Suss7nan*l974], pp. 10-11) diagrams HACKER's process state fjwNi buggy first attempt on this 
problem* Each box represents a stack frame; the horizontal axis represents time, the vertical axis 
r«P r ^f* depth of procedure calk. This diagram matches the pattern (part b of the f igurt) for 
the bug type. Prerequisite Cldbers Brother Goal. Once the difficulty is thus classified, repair 
knowledge associated with that type of bug may be applied. 

A predecessor of this diagnosis technique can be found in, the PLArflx capability of 
the STRIPS problem sc^ei* [Fikes 19721 In executing a plan, PLANEX checked for model 
predicates being accidentally undone. HACKER generalized this by checking for situations in 
which previously satisfied predicates are "intentionally" undone, i.e., where the plaa itself is flawed. 

Process diagnosis can fail when tfoe subgoal interaction is too complex for the debugger tp. 
recognize. DAPR would next resort to plan diagnosis, a new debugging ^hnique not previously 
formalized, to aid in isolating the culpable design decision. 
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FIGURE 18 
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Debugging .(AND (ON A B) (ON B C) ) Using Process Diagnosis 




L 



- — J 


5 








a. Schematic Diagram of HACKER's Buggy Process 
s * 



Step I 



Stcp2 
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b. The General Patterrt for PCBG Bugs 



[from. Sussman 



^974 , pp. 9-10] 
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4.a Ran Dtttnotit ^ 

Plan diagnosis is based on the fact that the planner has available knowledge of various 
heuristic decisions It has made^fech may prove unsuccessful Associated with each node of the 
derivation tree for a PATN plan would be a specification of the values for a set of semantic 
variables. The values of these semantic variables cor r espond to "snapshots" of ihe contents of the 

ATN*s registers at the time that the node was generated. The CAVEATS variable Is the 

i • - 

repository for advice regarding heuristic planning choices, for use in plan diagnosis 

i * 

Were PATN to decompose a model linearly* for instance, without apy actual proof that no 

Interactions existed, that fact would be recorded in the CAVEATS variable associated with the 

* ^ . ' ■ 

appropriate node of the derivation tree Of course, such a simplification may turn out to have 

been incorrect -Consider, aj a specific example, the task' of drawing a face on the bajls of the 

following mqdel. 

^ A FACE consists of two EYEs, a NOSE, a MOUTH, and a HEAD. (The two 
eyes are called LEFT. EYE and RIGHT. EYE.) The HEAD and EYEs joist be 
CIRCLES. The NOSE must be an equilateral TRIANGLE. The MOUTHjsust 
^ be a LINE, the EYEs, NOSE, and MOUTH must be Inside the HEAD. The 
EYEs are to be "above the NOSE. The MOUTH should be below the NOSE. 

MOOEL FACE 

1 PARTS LEFT. EYE RIGHT. EYE NOSE HOUTH HEAD 

2 CIRCLE (HE AO LEFT. EYE RIGHT. EYE) 

3 EQUITRI NOSE 

4 LINE. MOUTH ... 

5 INSIDE (LEFT. EYE RIGHT. EYE NOSE IWUTH) 1CA0 
.6 ABOVE (LEFT. EYE RIGHT .EYE) NOSE . ~ ' 

7. BELOU tJOUTH NOSE 
ENO 



in the absence, of specific critics (i.e., Before PATfl had learned of the peculiarities of INSIDE) 
PATN would design the eyes and the head independently. But if the head and eyes are all. circles 
of the same default size, then satisfying the relation that the eyes shouM.be inside the head will be 
impossible. A linear plan that Mves for the main steps independently of the relations leads to a 

in*.; 
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DAPR would localize this difficulty using plan diagnosis. The key step Is notrclng the 
existence of a caveat, stating that the linear treatment of the subgoals for EYES and HEAD was 
Justified only on heuristic grounds. In the absence of other guidancei'thls signals a potential bug. 
A closer Investigation of the semantics of INSIDE would indicate a non-llnearlty with respect to 
the size property, which would then be recognized as the source of the problem failure to observe 
a relevant pragmatic' arc constraint on exit from the CONJUNCTION node (due to prior 

i 

ignorance of that constraint). 

PATN need not continue to make such mistakes In the future. Future performance could be 
Improved by associating a critic with the conjunction plan node of the ATN. Thus, in subsequent 
problems, If two parts were described by the INSIDE relation, nonlinear planning would be 
chosen Immediately. In particular, the model would be modified to impose size properties on the 

parts so thaf, in terms of the revised problem description, linear decomposition wot*d then be 

» * » 

possible. 

Caveats for use In plan diagnosis would also be generated when heuristics are employed 

\ " ' ' ' ' 

during problem reformulation. The planner might construct what it. believes to be. an equivalent 

problem statement, but not In f?ct rigorously prove the equivalency For example, two problem 

. descriptions might be equivalent only over a subset of the possible inputs, but the planner might 

•postpone determination of whether -inputs outs.de of that range are ever possible or allowable. 

Such an heuristic approach, though frequently successful, can cause, trouble. Hence, this too Is 

recorded 1 In the plan derivation and potentially notice* during debugging by plan diagnosis. In 

the case of allegedly equivalent reformulation, the CAVEATS variable associated with the- 

equivalent-reforfj^ftlon node of that derivation tree would comTln t^e warning that the 

reformulation r«^R>on heuristic assumption! which were not rigorously demonstrated 

When such warnings are noticed during bug localization. DAPR's action would be to call 

* upon more thorough analytic techniques - such as formal demonstration of equivalency -- to see If 
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the heuristic assumption involved was in fact incorrect, thereby leading to an inappropriate plan. 
Some critics could Involve such costly processing of the problem specification that, even though 
already teamed from prior encounters, they might not be applied during Initial planning. If plan 

* » * 

diagnosis points to a possible error, these crltks could subsequently be Invoked. 
4.4. Repair 

tiAPR s overall repair strategy foe buggy PATN plans, once the culpable decision has been 
localized, fs to undo the faulty choice and resume planning from that point. Selection of an 
alternative arc transition would be facilitated by proceduraUnowledge associated with. 

a. the violated model predicate* 

b. the bog type, 
c the plan -type, 

d. code caveats such as rational form criteria. \ 
Some of feils knowledge 'is domain specific (primarily knowledge of repair techniques for rifOdel 
predicates: Goldstein [1974] characteriied knowledge of this kind for the Logo world.) The 
remaining knowledge Is of the sort suggested In the discussions of the respective bug and plan 
types. For example, one repair strategy for a faulty equivalence reformuhtton, which failed to take 
into account the full range of Inputs,, is to design a conditional plan which separates the 
equivalence-preserving and non -equivalence-preserving inputs, and then to supply a separate 
solution for the non -equivalent case as well 
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4.5. Umitatiom of the ATM Theory of Bugj . • 

There are. of course, other kinds of bugs that arise in human programming that do not fall 
under the heading of rational planning errors. These range from execution errors to the 
construction of irrational plans. Execution bugs consist of those errors due to mlstyplngs. 
misspellings. Incorrect programming language syntax, noise on the computer line, and other such 
failures to successfully execute a statement of code They are often diagnosed by the conventional '. 
computing environments, simply as a result of the code being unrecognizable Repair is 
accomplished by correcting, the side effects, if any. of the erroneous command, and then re- 
executing an edited version of the line. The plan is not affected. ^ 

Irrational-plans can be precisely defined with respect to PATN. They correspond to making 
transitions that are not allowed in the planning network or failing to make' transitions that are 
reared. An example Sould 6e pursuing a repetition plan and falling to handle the terminal 
cases. PATN. as a theory of rational planning, does not explain these kinds of errors, and we shall 
not dismiss them further here. (However, some potential implications of this distinction for 
structured programming are touched upon in the concluding section.) 

Another source of dissatisfaction with programs (which we mention for completeness but d£ 
not pursue) arises from efficiency considerations. The Planning ATN is m>t^ a compiler and does 
not attempt to optimize the programs which are produced As outlined here. DAPR would be 
restricted to Erecting programs that fail-to achieve their specifications Programs that are far 

• * 

from optimal, but are nevertheless successful in terms of their models, are correct with respect to 
rational bugs. Howeverf an interesting question for future research is to explore the extent to 
which PATN-like hierarchical annotation could provide guidance to an optimizing compiler. 

In the next section, we elaborate the Stgjred Debugging approach to categorizing, 
diagnosing, and repairing rational errors, b, analyzing the debugging behavior of HACKER, 
Suasman's U973] bkxVs world problem solver. 
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5. ReconcephjaUzing TiflCKER 

M 

„ the current bug classifier in HACKER is an ad hoc program and thus, the body 
of Knowledge (celled Types of Bugs in the overview flowchart) on which it 
operetes is difficult to separate out and display. This, of course, makes Types of 
% Bugs also very difficult to extend. The hope it, however, the} Types of Bugs it 

essentially independent of the problem domain and need only be expanded when 
new problem tolving methods (the Programming Techniques Library) are. 
introduced /tn important area for development 'of HACKBWike problem solving 
methods would be the systimatization of the knowledge in Types of Bugs in a ^ 
more modular way. 

Sussman, A Computational Model of Skill Acquisition, pp. 103-104 4 

t 4 

Sussman's HACKER program represents a landmark in AI theory for Its emphasis on 

debugging as in Important constituent of learning. However, HACKER is theoretically 

incomplete, in that it falls to Integrate debugging expertise with a theory of plans. The underlying 

bug types In HACKER appear ara miscellany of debugging knowledge With no underlying 

regularity. The classification afeorithm that maps manifestations to causes is ad hoc. 

. We shall extend the HACKER paradigm by developing debugging knowledge in the context 

of a coherent theory of planning From this vantage point, the underlying causes of bugs are seen 

at specific errors In plan synthesis. The types of causes follow straightforwardly from the possible 

fallings in traversing an ATN: falling to make an arc transition (incomplete plans), or making an 

Incorrect arc transition (inappropriate plans). For example, failure to generate code to achieve the 

- prerequisite conditions for a primitive constitutes a smantlcalty Incomplete plan. 

In this section, we analyze HACKER from the >P ATN standpoint. The purpose I* to 

demonstrate how PATN provides: 

(I) greater theoretical cMrity, by means of a Unified planning and debugging 
theory; 

£w (2) greater depth and breadtli. by means of natural extensions to HACKER's set of 

# bug types and debuggtfl£ techniques 

There are 1 our bug types in HACKER: Prerequisite Missing. Prerequisite Clobbers Brother 

ERIC * » 
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Go* Prerequisite Conf lias With Brother, and Strategy Clobbers Brothel We analyre.each in 



turn. 



5.1. Buet Anting from I ncomplete Plana 

The HACKER bug type, "Prerequisite Missing." Is a special case of incomplete planning. 
ThU bug commonly arises in situations wherein the accomplishment of a model predicate depend* 
critically, on the particular environment in which the procedure is executed. Some^mes failure to 
generate code to satisfy a prerequisite (because it Will happen to be true already in the expected 
initial environment) will be recognued as such during planning, and recorded as a caveat. The 
issue of dependency on the initial state was discussed in [Goldstein 1974. pp 85-88] In which 
ASSUMPTION Commentary was used to record known dependencies between the prpgram and lu 
,„itlal environment For (he blocks world. Sacerdoti [1975] used what he termed phantm node, to 
represent goals which happen to be true in t* initial state, but which would otherwise need to be 

accomplished. ' " 

•v-NA rational planner ma, not reaHte (or be prepared to take the extensive time necessary to 
deoue'e) all potential interaction* between the model and ever, possible (or intended) Initial 
environment For example, a plan ma, be used because the Post Model in the answer library' 
matches the problem statement; but the planner ma, not prove that all 4he statement, ,n the Pre ' 

Model must be true for all run-time environments. Hence, the plan might not be complete with 

respect to a new environment." In this situation, debugging consists of modifying or extending the. 

plan to satisfy the set of newly violated predicates. 

During cauful evaluation} 9 missing prerequisite, are manifested by primitive, generating 
- complaints. In the blqcks wo, id. for example, the robot will complain If asked to move a block to a , 

position that, some other object already occupies, or to grasp • bkx#iose top Is cluttered. 
Analogous complaints are generated by Logo turtle primitives. Logo will complain If the turtle I. 
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asked to move off the screen or if a turtle command U executed prior to the display being created 
by a start-display function. 

A unified approach is possible, which subsumes both the complaints generated by primitives 
and the broader class of model violations (referring to a program's failure to accomplish its goats). 
This synthesis is obtained by the use of Pre Models. If a Pre Model is associated with each 
primitive, then unsatisfied prerequisites simply become model violations. For example, as 
explained 'in section two, the Pre Model for the HACKER operator Mom Hock X onto Hock Y 
* would contain the assertions: . 

(CLEAR TOP X) ;X Must have a clear top to be picked up. 

(ON X 0L0-P0S1 TION) ;X «u9t be at worn known old post tton. 
(SPACE -FOR X Y) i The top of Y muni have roo« for X. 

1 4 

- ' The inclusion of unsatisfied prerequisite manifestations in the class of model violations, and 
^ the classification of prerequisite mining bugs as semant tatty incomplete plans allows a unified 

treatment of diagnostic ami repair techniques. Each model predicate, whether part of a primitive 

operator's Pre model or a problem's model, has procedural knowledge associated with it that aids in 

— 

# 

isolating the bug locus, proposing repairs, and thereby completing the plan. 

^ 5.2. Butt ArWgj from Incorrect Conjunctive Plane 

Prerequisite Clobbers Brother* Goal and Nonlinear Composition 

/ Prerequisite Clobbers Brother Coal (PCBG) and Prerequisite Conflicts with Broker (PCB) bugs 

/ • 

both arise from a linear plan being applied to a non-linear problem. PCBG is the underlying 

cause when attempting to build towers Incorrectly from the top down. In HACKER terms, the goal 

is (HAKE -(AND "(ON X Y) (ON Y ZH ). HACKER's default solution is to achieve the conjuncts In 

the order in which they appear. That is, this bug arises in situations in whicfi the planning systeln 

0 ignores the possibility that one con Junct may have to be accomplished prior to the other. From the 

, PATN standpoint, this bug is, caused by the planner following the (pragmatically Inappropriate) 

ERLC 
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linear arc from the conjunction nod*. PATN's default, as explained previously, is to choose a 

litfear plan except when non-linear composition or decomposition critics detect an interaction. 

In these terms, it is clear how debugging is to be accomplished. DA?R would re-apply PATN 

to the problem with the advice that a linear plan is prohibited. This knowledge is represented as 

an NLC predicate on the'arc from the CONJUNCTION node to the NONLINEAR 

COMPOSITION node. 20 (See figure 7.) The predicate checks for^patterns <5f the form. 

(AND (ON X V) (ON Y ZD, in the problem model? If they occur, planning control is transferred 

to the NONLINEAR COMPOSITION node, with composition guidance being appended to the 

ADVICE register. This advice, comf^d by the NLC predicate, directs the order of re- 

compotition when planning eventually reached the. Sequential Refinement loop. (See the overall 

ATN flowchart of figure 2). For the f tower example, the effect of the advice is to ensure that the 

plan for achieving (ON X YJ is executed after the plan for (ON Y Z). 

Sussman analyzed these bug detection patterns, but had no -coherent place for them in. an 
« 

overall theory. From the standpoint of an ATN planner, they represent constraints on arc 
transitions, and their ef fects are to set registers to guide subsequent planning. 

Prerequisite Clobbers Brother and Nonlinear Decomposition 
PCB arises In the following problem: HACKER is asked to find space for both blocks A and 
B on base block C, I.e.. to accomplish figure 19b In attempting this problem linearly, HACKER 

first places A on the center of C (figure Hk) f with no consideration of the brother goal of placing 

« 

B on C. When the time comes to place B on C t there is insufficient room and block A must be 
pushed left (figure !9d). This results in a Double Move (rational form) manifestation. 
HACKER's debugging strategy is to construct a plan that simultaneously takes account of both 
prerequisites. (PLACE-FOfl A C) and (PLACE -FOR B C) 

The PATN-DAPR approach is to Jiave the debugging episode produce a non-linear 
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decomposition critic that triggers on multiple SPACE-FOR predicates: JSPACE-FOR X Z) , 
tSPACE^pta Y Z). After triggering, the critic's actitgi is to append to the problem description 
register, r M, location predicates for X and Y with respect to Z. Given explicit locations, * linear 
decomposition can take place, 

PATN does not go beyond HACKER in handling this difficulty. The only claim here is that 
the*ATN representation helps in understanding the issues Involved, The planner's classification of 
conjunctive non-linearities into non-linearities in *the decomposition for in the composition (e{. 9 
their order) makes both PCBG and PCB understandable - and even to be expected - given a 
default preference for linear plans. > 

0 — » 

5.3. Bu£8 Arising from Incorrect Disjunctive Plans 

/ The bug Strategy Clobbers Brother (SCB) arises when two different strategies are attempting to 
-accomplish the same goal, but conkct with each other. The particular blocks world example 
discussed in HAefcER-"lnvolves the flndspace strategy "remove block from surface" conflicting 
with Its brother strategy "compact by pushing to the left" (figure 20). Removal can undo a prior 
compacting. HACKER notices the conflict and debugs by Imposing an ordering on these 
strategies. Removal ought to be accomplished before compacting. 

SCB can be understood In PATN term* as arising from an incorrect transition at the node 
for disjunction plans. -The disjunction is in the set of alternative strategi^ for accomplishing the 
FINDSPACE goal. 1 Although disjunction plans were not covered in section two; extending the 
basic PATN design to handle this additional logical operand is not difficult. Figure 21 Illustrates a 
planning taxonomy for the decomposition of disjunctions. 

The first major decision Involves resolving whether the disjunct* are exclusive or additive. 

* * 

Exclusive disjunction refers to a set of options in which oniy one can be chosen. Exclusive 
dlsjuncts cannot "partially" succeed. Crossing the Atlantic by steamer or plane are mutually' 
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Kisive travel strategies. One does not travel half way by plane and then switch to ship. 
Additive disjunct* can partially succeed and Indeed may behave cooperatively Strategies for 

finding space are of this kind. However, after deciding that the disjuncts are cooperative, the 

- * * 

question of whether there are possible interactions is still open. We Intend to Implement this In 

» i^i ^ 

PATN in a similar fashion to the handling of conjunction, with linearization cycles. * 
• * . 
Relative to this taxonomy, the underlying cause of SCB is an inappropriate arcchoke, similar 

/* , . 

to PCBC and PCB. The difference is only that the nonllnearlty which has been ignored Is 

; • • (. ■ . * • - 

relative to alternative disjuncts, rathef than conjuncts. The planner may have chosen, by default 
to treat subgoals as independent additive disjuncts, when In fact they' are dependent: subject to a 
non-linear constraint on their order of application. The appropriate debugging techniques are also 

similar, with corrective knowledge being attached to the arc transitions out of the'DIS JUNCTION 

v 

node of the ATN. 

5.4. Genorolitini the HACKER Paradigm 

This section has argued that analysis of the faults in plans as Incomplete or inappropriate arc 
transitions provides a unifying framework In which to understand the miscellany of HACK ER 
bug types. We conclude this aspect of the discussion by summarizing the dimensions along whkh 
PATN allows a broader view ofprogram planning and debugging than is present In HACKER. 
^ -I. HACKER contains an implicit theory of planning, consisting of an assortment of 
programming techniques. A program is written through successive macro expansion using these 
technique* We think that the PATN framework surpasses^ ACKER along thivdliO|gllon, % 
bringing .greater-organization to planning. Rather than as a "bag of/tricks" [Sussman 1973. p^% 
PATN would organize programming knowledge as decomposition' techniques that convert ^be 
standard- logical operators— AND, OR, FOR-EACH -. into procedural form From this, 
standpoint, H ACKER 'j program writing capability -is a subgraph of the planning ATN, consisting 
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of the identification and decomposition portions, but excluding problem reformulation. * 

2. HACKER is crltteallydependent on the annotations associated with the programMt writes; 

* 

but no clear theory of annotation 4s present The linguistic analogy ^underlying PATN leads to a 

concept, of -program annotations the hierarchical derivation tree that the ATN generates, 

augmented by .semantic variables associated with npdeMn the derivation tree (which specify, such 

contextual information as the problem specification, debugging caveats, and%re-composltion 

advice). The set of semantic variables available during debugging is not arbitrary or ad hoc, but 

i - 
corresponds to snapshots of the contents of rtw ATN's registers during planning, P ATN's notion 

of commentary follows from the structure of its grammar, and from the semantics and pragmatics 
of its augmented transition network. m 

3 By having a comprehensive set of planning constructs, it is possible to predict additional 

types of bugs. For example, just as the wrong choice between linear and non linear conjunction. 

* » * 

plans leads to bugs, so too dc*s the wrong choice between any set of mutually exclusive planning 

arcs eftfnating from a given node. Thus, a similar class of bugs can be expected to arise In 

deeding between round (simple tail recursive) and fully recursive repetition plans, and. indeed. In 

human problem solving', this confusfon is often displayed Another class of bugs arises when one 

conjunct does not completely "clobber" another, but partly Interferes The potentiality for this is 

apparent when it is remembered' that problem descriptions may be more complex Ibglcal models 

* » 
.than those afldressed by HACKER. An example of this l^the blocks world is, "build two green 

lowers " There may be no interference between the choice of color, but there may be interference 

*in the choice pf blocks, as would occur if only a limited number of blocks were available. 

4 .^ACKER'S critics can be characterized as transition constraints on ATN afcs* From this 
broader viewpoint, one immediately* notices the possibility for positive as well as negative critics, 
which argue for or against partkilar plans More generally, given the jituatlon^of choosing a 
transition arc out of a given state in the planning network, a critic Is simply some selection function 
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M^hWrcs. . t ^ 

5. Unsatisfied prerequisite manifestations can be considered Instances of the more general class 
of model violation*. All Chat Is needed U to include operator models as well as problem models. 
This Is not an 'added burden, since operator models are necessary anyway as part of the primitive 
library used by the Identification planning technique. 

In concluding our discussion of HACKER^ we must stress that we agree with the ov<{all^ 

HACKER philosophy that problem solving consists of both planning and debugging. Our 

/ * . • 

objection is that HACKER treats these two complementary activities in an isolated fashion. 

HACKER does not pay sufficient attention to the theory of description for problems, for operators 

' * < / * 

and for plans. We have tried to illustrate how dur linguistic theory, of planning and debugging 



remedies this. 
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6. Conclusions n 

The prbper stud/ of those who are concerned with the artificial Is the way in 
which that adaptation of means to environments is brought about — and central 
v .to that is the process of design itself. The professional schools awill re assume 
^ffieir professional responsibilities just to the degree that they ca^ discover a 
science of design, a body of intellectually tough, analytic, partly formafizable, 
partly empirical teachable doctrine about the design process. 

Simon, The Sciences of the Artificial; p. 58 * 

In striving to achieve a rigorous, unified theory of planning and debugging, we have used 

concepts from compujjp^nal linguistics to characterize trie problem solving process. Planning 

concepts were represent using an augmented transition network, resulting in a structured theory 

of planning which appears to be both pdwerful and clear. Debugging was analyied as the 

» * "* 

diagnosis and repair of incorrect or incomplete plan*, which inevitably arise in the course of 

%• 

rational but heuristic planning. We conclude by summarizing the limitations, extensions, and 

potential applications of the Structured Planning and Debugging theory. 

■ * / - 

£.1. Limitation^ and Extenaiont of Structured Planning 

My mind was (truck by * flash of lightning in which its desire was fulfilled. 

• Dante, Paradiso (Canto XXXHI), in [Polya 1965, p. 54] 

Of course, there are many aspects of human problem solving and iujtashts of Ughtnln^thmt 
we have not touched upon. What follows is some- of the specific limitations that we perceive in the 
theory embodied by PATN, and possible extensions to remedy them. 

In section three, we discussed, bow the generation algorithm running over the ATN coujd b« 
improved. These Improvements could obtain better performance within the boundaries implied by 

the knowledge present in the network. They do not address thoie limitations Inherent In tht 

0 * ' r V ; 

particular subset of planning knowledge pfesent, l e , the basic taxonomy 

Bearing in mind that our problejrt descriptions are composed of logical operators, It is readlh/ 

ppaVent that the network currently contains techniqu^Jor solving conjunctions and universal 

• . 73 * v 
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. . \ 

* \^ * 

quantifications over a finite domain (repetition*); however, the network does not contain strategies 

\ 

for handling disjunctions, negations, or exiitenttal quantifications, These dearly could be 
Incorporated using the ATN formalism, but we have not addressed /the last two In this paper 
(Disjunctions were briefly discussed in section five.) 

Moreover, with techniques for all of the logical operators, the planner would still remain 
incomplete. Even If a problem is described as a conjunction, the planner may not find the 
constructive solution necessary to accomplish the conjunct! Interactions might exist that make it 
impossible, or the particular technique for resolving a certain interaction may be unknown. 
Nevertheless, we believe that the logistic framework for describing problems at least gives a super- 
structure on which to build more elaborate planning techniques. /The success of this super- 

structure <;an be evaluated by the exten* to which future research allows the collection of 
/ 

decomposition and lineariiatlon techniques to be extended within the ATN framework. 

Another PATN limitation lurks in the ad hoc nature of its reformulation techniques. 
Theoretically, a general theorem p rover xou Id enumerate alt equivalent models But such a, strategy 
would be computationally too costly to be useful. Instead, we enumerated a small number of 
heuristics. Future research might attempt to find a middle ground between general' deductive 
strategies and specific procedural heuristics.. Such an accommodation is suggested by recent wort 
on theorem proving [Kowalskl 1973; Moore 19751 

In designing PATN. we have emphasized an hierarchical approach to planning. Such a 
philpsophy is a simplification in that it does not take account of possible heterarchy [Mlnsky tc 
Papert 19741 By this tje mean that in some pbnning situations, a person clearly takes advantage 
of bottom up evidence to guide an ordinarily top-down analysis. Information and decisions do not 
inevitably flaw in a single direction. A robot that trips over a bag of money on its way t<J rob a 
bank should not tick the money aside and continue with the caper. Figure 22 illustrates an 
Heterarchlcal Refinement loop, in which goals can be reordered after each recurj^^solutton for a 
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subgoaL Eventually this sort of complexity must be addressed. However, our research plan ts first 
to construct arid experiment with a clearly, top-down structured planner, in order to better 
understand its limitations as well as its virtues. 



6.2. Summary of the Structured Pebucrini Viewpoint , 

I^p^^ftTTng DAPR, bugs and debugging were analyzed in the context of the Structured 
Planning tfieory underlying PATN. Since PAT^r^presenU planning knowledge using an 
augmented transition network, it is possible to describe the underlying causes of bugs as specific 
classes of erroneous arc transition decisions during planning. The general form of a bug can 
either be failure to include a needed constituent, or inclusion of an inappropriate constituent 
These failures can be caused by. ignorance of or failure to obey ATN arc transitions and the 

; 

constraints on those transitions. ( 

\ 

DAPR's debugging consists of diagnosis and repair. These activities are characterized by the 
various data structures on which they operate. PATN employrfoar representations for a 

* v 

procedure the problem description ("model"), the process fchrontext"), the code. and. the plan 

derivation* The theory provides a notion of annotation as derivation trees, which summarize the 

• I * 

N design decisions leading up to the actpal code. This thorough, hierarchical representation of the 

history of* the solution allows ft*- a clVeper analysts of debugging which we believe will be of 

practical value for example, in the construction of programming environments. ^ 

The ideas In this essay have developed, from those of Papert [I97la,b; 19731 tyssman [19731 

and Goldstein, [19741 To pVovide perspective on its relationship to earlier work, tfu^urrent theory 

was contrasted with^Sussman's HACKER. The claim that the present approach subsumes that of 

HACKER was defended by several specific arguments. The relationship of HACKER's bug types 

tO|the current classification scheme was discussed. 

t 
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In the remainder of this section, we describe various applications of the Structured Planning 
and Debugging paradigm: to protocol analysis, structured programing, and computer aided 
instruction. ~. 

6.3. PHtocoj Analytli 

In [Miller^ Goldstein 1976b]. an earlier version of the planning grammar was applied to the 

j 

task of parsing elementary programming protocols The recognition process was performed 
manually, by the authors. Continuing our strategy of applying concepts from computational" 
linguistics to problem solving, we plan to experiment with the application of various algorithms 
for natural language comprehension- to the task of automated protocol analysts ^ 

A, critical question that arises Is whether PATN provides z.spanmng model for elementary 
human problem salving. By this we mean if PATN is put ,#a mode where.n a generates all 
possible solutions to a given problem (primarily through successive reformulations), w.ll the set of 
programs produced Include most of the successful solution, generated by people' More critically. 
, can PATN's solution process - at an appropriate level of abstraction - mimic thai undergone by 
human problem solvers? More specifically, is the protocol analysis task profitably approached 
frorjfthe standpoint of determin.ng which * PATN's possible plans for a given problem Is being 
used? 

We do not know whether PATN will be sufficiently powerful to Include all of the plant 
• ' typically pursued by students in elementary Logo programming tasks. If so. It will represent a step 
forward in Information processing psychology [Newell ic Simon I9721 2 ' Our prel.ml.nary analyses 
of many Logo protocols have been encouraging. But extensive experimentation Is needed before a 
definitive answer will be available. Fortunately, we are* In a good position to attack this set of 
pathological questions because the Logo project has collected extensive data on student 
performance [G Goldstein 1973; Qkumura'19731 

o" ■ » 7s '• 
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[Hitler 8c Goldstein I976d] presents* preliminary design for PAZATN, a PATN-based 
automatic protocol analyzer In applying PATN to protocol analysis; we envision modeling the 
individual by inducing, from previously analyzed protocols, a personalized (modified) version of 
the Planning ATN. The success of these models will be Judged by the extent to which they 
successfully predict subsequent behavior qn the task. Ag>, experimentation is needed to 

.» determine whether this approach is viable. 

m The parsing problem is complicated in analyzing human protocols by the possibility of 
irrational planning errors and execution errors, in addition to the rational planning bugs discussed 
earlier. Because of the increased uncertainty Introduced by possible mistakes In executing a 
statement of code or constructing an ungraynmatical plan, we envision taking advantage of the 

' powerful search procedures created for parsing speech utterances (such as those described by 
Allen 119751. Woods et al. [1975], Paxton k Robinson [1975]. and Lesser et al. [1975]), In which 
uncertainty in the auditory interpretation similarly complicates the parsing process. 

6.4. Structured Programmin g . t " 

... the new reality is thai ordinary programmers, with ordinary care, can- ' 
consistently wnte-program segments which are error free from tbe start. • 

Harlan 0. Wis, "On the Development of- Large, Reliable Programs " Proc. 
••' ' Sfmp. Computer Software -Reliability, 1973, p. 155. ' 

It is sometimes argued by proponents of structured programming that discipline in coding cart 

eliminate all bugs *The Structured Planning and Debugging theory sheds some light on this issue 

Rational bugs are unavoidable (or, at least, not worth avoiding). They correspond to heuristic 

planning judgments mad* when na^etterTriteria were available, as often occurs when 

programmers are solving new problems. It is probably through the experience of whether their 

default heurTsTics succeed or faTT on a new class of problems that individuals acquire skill. On the* 

other hand. Irrational errors'and syntactic pbnningrbugs must surely be increased by unstructured, 

careless programming. It is this class of- errors, not rational, bugyhalwe believe the structured 
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programming movement as a whole has in mind, in calling for more disciplined planning and 
codings 

Hence/>|^potential application of our theory is to the design of Improved environments for 
programming. In [Miller k Goldsteln(l976c] we have presented the design for a programming 
editor called SPADE-O. which encourages articulate, structured planning, using a context free 
grammar. The virtues of working within such an editor, In which programs art specified In term* 
of their plans, include: (a) expressing one's programming ideas in this fashion can. lead to. 
increased clarity, by drawing the programmer's attention to the nature of median -being applied; 
auid <b) articulating the plan increases the system's leverage fb aid In the diagnosis and repair of 
bugs. 

However, context free grammars have limitations which prevent SPADE-0 from exceeding a 
certain plateau of utility. These limitations can be overcome by representing plan*, not In terms of 
context free rules, bur in terms of an ATN. Consequently, we envision using PATN to,extend the 
' capabilities of the SPADE editor, creating an improved version. SPADE-I. Qne might instruct this 
• improved editor to change a particular subgoal from being accomplished by means of 
IDENTIFICATION to a plan based on DECOMPOSITlbN by CONJUNCTION. The reason 
might be that the original subprocedure fetched from the library had unacceptable side effect*. 
SPADE-I, the PATN-based editor, could. then lead the programmer thVougb a sequence of top- 
down planning decisions that would realize the new plan. Because of the availability of PATN, 
SPADE-I could, among -other Improvements, assume greater responsibilities concerning low level' 
coding decisions. 

PATN is a top-down structured programmer As a result, the SPADE-I editor could asiist the 
programmer in exactly" this process. Thf advantages of such an editor over conventional 
~ programming environments, derive fmm a broader and deeper taxonomy of planning concept*. 
Thus, while (we believe that Dljkstra and his colleagues have pointed in the <lght direction, In 
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calling for a structured approach to programming (see, e.g., [Dahl et al. 19721). we also believe that 
the type of research involved in constructing PATN provides an essential next step: detailing 
exactly what rational planning involves. 

In futuli research, wr plan to construct the PATN-based SPADE-I editor, and to experiment 
with its performance as a programming tool The criteria by which it may be Judged are the 
extent to which programmers find it useful, and its effect on program writing and debugging time. 

6,5. Al-beaed Computer Aided Instruction 

In designing Al-based CAI programs, three critical problems arer (a) inducing a model of the 
student; (b) having a modef of~the~expert; and <c> generating a tutorial plan for guiding the 
student toward expert competence. PATN may aid in the resolution of these three problems In the 
design of CAI systems for tutoring programming and probler/solying. 

We have discussed how PATN may provide an Important modettng tool Implicit in PATN . 
is also a theory of learning. From the PATN standpoint, learning is the acquisition of new 
grammatical rules, new semantic variables, and new pragmatic constraints for deciding between 
alternative plans. Hence, a PATN-based tutor could compare the topology of the personalized 

ATN Induced for the student to the full PATN grammar, and choose a di^rence as the issue to 

* 

be taught. Alternatively, the tutor coOW parse a given protocol, compare it with how PATN would 
have solved the problem, and utilize the differences as the specific issues to be discussed with the. 
\ student in analyzing his or hec performance on the problem. For example, a pragmatic p la fining 
bug might be^ttributable to the absence of a relevant critic. In this fashion, we attempting to 
extend the Issues and Examples paradigm, developed by Burton and Brown [1976] for an 
elementary arithmetic world, to thf more complex environment of programming and problem 
solving [Gfctdstein k Miller 1976al f 

Of cotirse w there are many other subtleties in designing Intelligent computer tutors not touched 
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upon here, such as: (a) in what sequence 'should the knowledge be taitght? (b) hoy intrusive 
should the tutor be? (c) v how can the tutor's behavior be explained to the student, so that it; actions 
are not mystifying? and, (d) cah sufficiently powerful natural language capability be provided so 
that the student can interact Comfortably with the tutor? Nevertheless, PATN Is a necessary $\ 
ingredient, as it provides a model of the planning expertise whiab Is tp^e conveyed by the tutor. 
It is also worth observing that automatic protocol analysis and student modeling, even without 

automatic tutoring, could be valuable to a human teacher. The parsed protocol and student model x 

* ' •** 

might allow the teacher to notice, more easily When the student is relying on a limited lexicon of 
planning strategies, and whether the strategies that are known are organized in a successful 
fashion. This kind of detailecKdescription of the reasonir^ process offers the possibility of 
escaping from the tyranny of standardized tests, whose outcome is an uninformatlve numerical 
score. 

6,6. The Science of Heuristic 

Polya has called heuristic the study of the "means and methods of problem solving* 0962, 
p. vil His various books (I957, I962, 1965, I967J offer insight into the nature of problem solving, 
discussing skills and abilities far in advance of the most intelligent AI programs. -"Bwjieurlstic, is v 
Polya develops it, is not yet a science. There are no formal representations for problem solving 
concepts; no rigorous means for experimenting with alwnative theories. The use of the computer 
to implement and experiment with silch theories makes the study of heuristic a science. PATN * 
represents a small contribution to this enterprise by experimenting with a particular procedural 

r 

* 

representation - the augmented transition network. 

JFhe most commorifcriticiim of even the most insightful analyses of problem solving is - "but 
how can I realize when ai particular probiem solving strategy is appropriate?" The gap that exists 
between informal, iittuitive discussion* of thinking, and specific, useful guidelines, is illustrated by 
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* thyself description of the greaTfitttheroatlcian fcoinc*r? cited in section two: 

Ev.ery diy I. set down at my tebl^ and spent an hour or tvrO trying-a great 
number ot combinatiens 9 ~>nd I arrived jrt no result. One nifbrl took some black ft 
„ N coffee, contrary to my /ustoiit, ari<f was unable to sladpTA host of ideas % Kepj 

surging in,*iy head; (could almost teel Jhem jostljpg one another, Ontil two* of f 
them coalesced, so to speak^ Wrform a stable com^fnation. • - • 

Poincare r H, "Mathematical Discovery.^in [Rapport 1963, p. 132} • 

Surety we can*do better than advistn^f student to drink coffee befdre going to Heep 



x Attempting to structure the skills^of various fields, whether mathematics or carf^ntry --In a 
* # * form that provides useful, precise guidelines to students - is the fundamental task of education. 
Research" in computer science, computational linguistics, and artificial intelligence Is finding 
* representations^ for" active, knowledge thaype precise, powerful, and perspicuous. Ultimately, 
%PATN 9 s most important contribution is ?s an experiment In this vein: exploring whethe||i 
particular computational formalism is useful as a representation of problem totyjng skill. As .such, 
. it is a vlul pari^of that investigation of the design process which sfmqn talls-for in the quotktion 

• '. ' •* .* V; • ' * r . 

* with yhlch we began this section. f ^ ' * • • 
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1. The name Structured Planning and. Debugging emphasizes several themes. OriViWroe Is 
that the use of concepts from computational, linguistics has been, helpful to us in structuring our 
theory. Expressing a cognitive theory jn terms of a computer program, while perfectly rigorous, is 
not' necessarily perspicuous. For example, in the current essay the use of the ATN helps us to 
organize th* procedural knowledge we are trying to characterize. A second theme Is that problem 
solving consists] primarily of two complementary activities.- planning and debugging. Previous 
research has typically emphasized only one or the othet. at the expense of both. A goal.of our 
theory is tA provide an integrated understanding of both processes. A final them? is^hat detailed 
study of the p/oblem solving involved in program design » a prerequisite for completely fulfilling 
the structured^rograniming movement's objectives, such as program reliability We wish^ 
emphasize thYpotential role of our research in this enterprise. 

2. See also [Woods, Kaplan & Webber 19721 Woods' [1970] definition w ? i an elaboration and 
forma luatipiupf earlier work by. Bob row and Fraser [19693. and by-Xhocne. Bratley and Dewar 
'fjfcs} Woods attributes some aspects of the ideas to Kuno [1965] and Conity [19631 

: ./~ 1 \ • -. ■ ^ 

1 While the emphasis of the current essay iron investigating the appropriateness of an ATN, 
formalism for dinning concepts, we have also found the context free grammar representation to 
be a ffuitful delEripfcon of planning concepts/or certain purposes, such as parsing human 
programmtngi protocols ' This suggests that Heidorn's [»75] ACFC (augmented context free 
grammar) formalism might be an effective alternative to the ATN Its virtue"* that the 
^relationship to the CFQ characterization of our ideas would be more direct Moreover, our actuar 
implementation of PATN might tiyn out to be closer in spirit to an AfcFG model than 'an ATN. 
To "some extent, the distinction is secondary, since ACFG's and ATN's are.not only formally 
equivalent jn. power, but also structurally comparable in a straightforward manner In any case, 
while -ACFG's suggest ihteresfing possibilities, resolution of this issue goes beyond the current 
paper f J*f ; 

' 4 We should, emphasize that we do not regard this taxonomy as being either complete or 
unioue In later sections we 'discuss particular ways in which it is incomplete In [Miller * 
Goldstein I976bkwe presented a different version. In the context of parsing a student protocol. 
The earlier taxonomy emphasized examining the directions from whence- a planner could obtain 
guidance; the current one emphasizes examining uy logistic 1 description of {he problem at hand. 
Wfcile^our intuitiori suggests that our current *ersion is an improvement, persuasive evidence for 
1 favoring a given classification of 'planning concepts must await implementation and systematic 
experimentation. The reader is referred to [Miller ft Goldstein 1976a] for an overview of our 
research project as a wmole. . - „ ' V* 

5. This is an overiWlif k»tion. Tf every solved problem were added to the answer library. 
. the experienced- problem solver might be overwhelmed by tremendous numbers of uninteresting 
sdWfions The possibility of "intelligent forgetting" is a subtle-issue which we are. not currently In 
a pojttion'to address. • . 

6 Our use of the term model should not be confused with its use in model theory, The name 
-clash is'uotortunVte, resulting*? rom historical accident. In most cases our torn mffdel can be 
VPlaced by the phrase problem specification without altering the meaning «r 
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7 The predicate calculus is the problem de'scription language of mathematics as well as a 
variety of AI programs, most notably the STRIPS series of problem solvers [Fjkes k Nilsson,l97l ; 
Flkes I972j Fikes et al. 19721 Alternative problem description languages, b'ased upon such concepts 
at frameslM|nslivl975; Winograd 1975; Goldstein 19751 might praytte^jncreased expressive power, 
we have- yet to thoroughly explore this issue. For our pur ptoses in this article, thf -problem 
descriptions arekgmply a, conjunctfon of properties and'relatlons about some set of objects. As 
sucjw they are clmmon to most descriptive schemes including the predicate cakulus^framrt, and 
semantic nets [Quilhan, 1968; Winston 1975; Woods 1975]. In practice, of course, our problem / 
specification language Is actually LISP: but the subset-of LISP which is used can be viewed In a 
var^y of guises " ' • V 

♦ * * " 

6. \\ is possibJc that problems should also be indexed by their Pre Mddels, if any. This wouW 
enable the system to support a kind of forward chaining. At the present tin*, the additional 
overhead which this would entail daps not sefcm justified by its possible utiHty, at least for the 
simple blocks world and Logo picture prfcbjenu we are considering. 

9 For a>apre detailed discussion of the link between turtle primitives and model description*, 
see chapter six of [Goldstein t9T4l^A glossary of pHmRTve predicates f of describing elementary 
¥ Logo pictures may be found in Goldstein's Appendix B. 

JO- Or^ly implementation and experimentation can ultimately determine whether a given set of 
. reformulation techniques will be adequate. A related problem for! future research is construct a 
program that attempts to induce the model from a sketch. Yhe potential, ambiguity introduced by 
such a moduli would place an even greater burderi on the reformulation strategies. 

1 . * 

; II. See rPotya # l965 f ch. 9J for a relevant discussion of Problems frith in Problems. 

12. There are of course many additional ref ormulatiq^ teffitques. Many complex issues 
involving change of representation arise, suggesting rich areis^Sfturther research. 

13. Strictly tpeaktng, what Sacerdotl terms procedural -nets are actually, partially ordered 
program steps. The authors are indebted to B. Kuipers for reminding them th*t such partial 
or ders are restricted cases of networkVwfth additional properties useful to bp^ NOAH and 
PA*TJM. - • 

14. An alternative is to save the solutions to subproblems only in a working lemma library. 
The issue is whether each^mma is permanently stored for future reference, or only saved for the 
duration of the* problem whand. Techniques for determining the potential future relevance of 
subproblemsy art rtbt discussed in this paper. I' ? . * 

15. We int/odmce, DAPR here because we have fotind tha{ the metaphpr of designing it 
program is ausefuPway to organize our ide^s. Wp <Ja> in fact, intend for thiJVdesign to serve as 
the^asss for implementing a drugging module, At the same time, we are awar^ that the set 
ideas presented are lno>mpletetsa||jp ajchitecturf of theJdebugging module, DAPR, is only^ partlaM^ 
specif ted in this repon^ " ' % *' ~\ . ' . 
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16. TJiis view of the causes of b^igs Is a simplification. Some bugs have multiple Underlying 
causes, a situation which greatly complicates the troubleshooting process, Nevertheless, 'the 
techniques dev^ged here are useful, in that proceeding under the heuristic assumption of a single 
ca^se is often reSonable evtn in cases where th* assumption"tufns*out to be false* 

17. In' the general case, model diagnosis requires .addressing difficult* problems of symbbllc 
evaluation (see, eg, [Yonezawa 197^]). For most of the programs discussed here/a simpler 
approach; performance annotation [Goldstein 1974] is possible A direction for research is to extend 
the range of programming constructs whlc|i can be. verified by the model diagnosis module, 

18. DAPR's "three diagnostic techniques are presented -fii roughly the order in which tfiey 
would be applied It is conceivable' that this strict ordering would not be adequate That is, there, 
may be debugging siti^tions for which proceij dfagnftsis should be applied iprior |o model 
diagnosis, or even situations for which the most effective debugging .ftr^tegy would be alternate, 
applications of both strategies, and so on In the Jlrst implementation of DAPR we will 
experiment with the simpler approach '* 

"|9. Careful evaluation [Hewitt Sc Smith 1975; Gcrtdsteln 1974, SussrAan 1973] Is a diagnostic tool, 
whereby a program is tested/by interpreting it in an extremely cautious mode, ^Hth extpnslfe 
checking of argument typesjprerequisite satisfaction, etc. During .normal evaluation it would be 
prohibitively expensive to routinely inctude such checks. 

"20 PATN's default arc ordering and arc constraints are designed to ensure^iat non-linear 
planning is pursued if and only if a speclflopattern of interaction is detected. The local decljJon 
process may ^described as follows. PATN first tne^the'twd nonlinear arcs Control trapsfeft to 
the corresponding states only when an NLC or NUD predicate "accepts" the model Otherwise, the 
linear decomposition & purged 

21. It'is worth considering the" relationship between. Newell Se Simon's [1972] ^reduction system 
model and PATN. Strictly. ATMs are Isomorphic to production systems.ln formal power; they are 
also directly analogous in internal structure. A production system consists of a set 'of 

••[pattern m\ action] rules which operate over' a finite number of short term" memory (STM) location*. 
An ATN may be thought of as a production system in which a particular slot in STM. the state, \i 
distinguished The arc transitions correspond to rules, where arc contrajnts map onto -the left hand 
'sides,. and arc actions map onto the right hand sides. Distinguishing between the "state" register 
and "other ("data") registers seems to have the virtue of imposing greate* structure onjhe otherwise 
homogeneous collection of productions. AH the reputed advantages of rule-"based' systems, such *s 
modularity, still apply^ The other-STM slots directly correspond to the register; of the ATN 
model. Moreover, the ATN model^ suggests a natural decomposition of the .knowledge In a flven 
rule, into syntax, semajmet, and pragmatic constraints- One* application of this breakdown is In 
teaching: rather than(tuTo>ng an entire rule, 1t may be that only one part need be taught. (The 

■ authors arf Indebted tds£ Kuipers for emphasizing the Importance of this comparison.) 
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